11 papers · ranked by Valyu relevance
Jan Janssen, Janine George, Julian Geiger, Marnik Bercx + 7 more
'Christina Ertural' 'Joerg Schaarschmidt' 'Alex M. Ganose' 'Giovanni Pizzi' 'Tilmann Hickel' 'Joerg Neugebauer'] Numerous Workflow Management Systems (WfMS) have been developed in the field of computational materials science with different workflow formats, hindering interoperability and reproducibility of workflows in…
Martin Uhrin, Sebastiaan P. Huber, Ju‐Song Yu, Nicola Marzari + 1 more
'Giovanni Pizzi'] Over the last two decades, the field of computational science has seen a dramatic shift towards incorporating high-throughput computation and big-data analysis as fundamental pillars of the scientific discovery process. This has necessitated the development of tools and techniques to deal with the…
Sebastian Pohl, Nourhan Elfaramawy, Kedi Cao, Birte Kehr + 1 more
'Matthias Weidlich'] Scientific workflows automate the analysis of large-scale scientific data, fostering the reuse of data processing operators as well as the reproducibility and traceability of analysis results. In exploratory research, however, workflows are continuously adapted, utilizing a wide range of tools and…
Caspar Schmitt, T. Kuhr
A workflow describes the entirety of processing steps in an analysis, such as employed in many fields of physics. Workflow management makes the dependencies between individual steps of a workflow and their computational requirements explicit, such that entire workflows can be executed in a stand-alone manner. Though…
Gregor von Laszewski, J. P. Fleischer, Geoffrey Fox
In this paper, we summarize our effort to create and utilize a simple framework to coordinate computational analytics tasks with the help of a workflow system. Our design is based on a minimalistic approach while at the same time allowing to access computational resources offered through the owner's computer, HPC…
Boris Yamrom, Yoon-ha Lee, Steven Marks, Lubomir Chorbadjiev + 2 more
Snakemake is one of the most popular workflow management systems, particularly in biological sciences. Snakemake workflows are highly portable, scalable, and transparent. Moreover, they enable the painless reproduction of published results and adaption to similar data processing and analysis projects. Here we present…
Taylor Reiter, Phillip T. Brooks, Luiz Irber, Shannon E.K. Joslin + 4 more
As the scale of biological data generation has increased, the bottleneck of research has shifted from data generation to analysis. Researchers commonly need to build computational workflows that include multiple analytic tools and require incremental development as experimental insights demand tool and parameter…
Stephen R. Piccolo, Zachary E. Ence, Elizabeth C. Anderson, Jeffrey T. Chang + 1 more
Command-line software plays a critical role in biology research. However, processes for installing and executing software differ widely. The Common Workflow Language (CWL) is a community standard that addresses this problem. Using CWL, tool developers can formally describe a tool’s inputs, outputs, and other execution…
Jason P. Kurs, Manuele Simi, Fabien Campagne
Computational workflows and pipelines are often created to automate series of processing steps. For instance, workflows enable one to standardize analysis for large projects or core facilities, but are also useful for individual biologists who need to perform repetitive data processing. Some workflow systems, designed…
Gordon Gibb, Nick Brown, W Rupert, Nash + 6 more
'Santiago Monedero' 'Humberto Díaz Fidalgo' 'Joaquín Ramirez' 'Adrián Cardíl' 'Max Kontak'] Abstract—In this paper we present a workflow management system which permits the kinds of data-driven workflows required by urgent computing, namely where new data is integrated into the workflow as a disaster progresses in…
Samuel Lampa, Martin Dahlö, Jonathan Alvarsson, Ola Spjuth
The complex nature of biological data has driven the development of specialized software tools. Scientific workflow management systems simplify the assembly of such tools into pipelines and assist with job automation and aids reproducibility of analyses. Many contemporary workflow tools are specialized and not designed…