14 papers · ranked by Valyu relevance
Jan Janssen, Janine George, Julian Geiger, Marnik Bercx + 7 more
'Christina Ertural' 'Joerg Schaarschmidt' 'Alex M. Ganose' 'Giovanni Pizzi' 'Tilmann Hickel' 'Joerg Neugebauer'] Numerous Workflow Management Systems (WfMS) have been developed in the field of computational materials science with different workflow formats, hindering interoperability and reproducibility of workflows in…
Martin Uhrin, Sebastiaan P. Huber, Ju‐Song Yu, Nicola Marzari + 1 more
'Giovanni Pizzi'] Over the last two decades, the field of computational science has seen a dramatic shift towards incorporating high-throughput computation and big-data analysis as fundamental pillars of the scientific discovery process. This has necessitated the development of tools and techniques to deal with the…
Sebastian Pohl, Nourhan Elfaramawy, Kedi Cao, Birte Kehr + 1 more
'Matthias Weidlich'] Scientific workflows automate the analysis of large-scale scientific data, fostering the reuse of data processing operators as well as the reproducibility and traceability of analysis results. In exploratory research, however, workflows are continuously adapted, utilizing a wide range of tools and…
Caspar Schmitt, T. Kuhr
A workflow describes the entirety of processing steps in an analysis, such as employed in many fields of physics. Workflow management makes the dependencies between individual steps of a workflow and their computational requirements explicit, such that entire workflows can be executed in a stand-alone manner. Though…
Gregor von Laszewski, J. P. Fleischer, Geoffrey Fox
In this paper, we summarize our effort to create and utilize a simple framework to coordinate computational analytics tasks with the help of a workflow system. Our design is based on a minimalistic approach while at the same time allowing to access computational resources offered through the owner's computer, HPC…
Gordon Gibb, Nick Brown, W Rupert, Nash + 6 more
'Santiago Monedero' 'Humberto Díaz Fidalgo' 'Joaquín Ramirez' 'Adrián Cardíl' 'Max Kontak'] Abstract—In this paper we present a workflow management system which permits the kinds of data-driven workflows required by urgent computing, namely where new data is integrated into the workflow as a disaster progresses in…
Benedikt Heidrich, Andreas Bartschat, Marian Turowski, Oliver Neumann + 6 more
'Oliver Neumann' 'Kaleb Phipps' 'Stefan Meisenbacher' 'Kai Schmieder' 'Nicole Ludwig' 'Ralf Mikut' 'Veit Hagenmeyer'] Time series data are fundamental for a variety of applications, ranging from financial markets to energy systems. Due to their importance, the number and complexity of tools and methods used for time…
Nishchay Karle, Ben Clifford, Yadu Babuji, Ryan Chard + 2 more
'Daniel S. Katz' 'Kyle Chard'] Abstract—The Common Workflow Language (CWL) is a widely adopted language for defining and sharing computational workflows. It is designed to be independent of the execution engine on which workflows are executed. In this paper, we describe our experiences integrating CWL with Parsl, a…
Marcin Cieślik, Cameron Mura
PaPy, which stands for parallel pipelines in Python, is a highly flexible framework that enables the construction of robust, scalable workflows for either generating or processing voluminous datasets. A workflow is created from user-written Python functions (nodes) connected by 'pipes' (edges) into a directed acyclic…
Panchal, Deven
—Generative Agentic AI systems are emerging as a powerful paradigm for automating complex, multi-step tasks. However, many existing frameworks for building these systems introduce significant complexity, a steep learning curve, and substantial boilerplate code, hindering rapid prototyping and deployment. This paper…
Philipp Diercks, Dennis Gläser, Ontje Lünsdorf, Michael Selzer + 2 more
'Bernd Flemisch' 'Jörg F. Unger'] - 12205 Berlin, Germany - 2Lehrstuhl für Wasser- und - Umweltsystemmodellierung, Institut für Hydromechanik und Hydrosystemmodellierung, Universität - Stuttgart, Pfaffenwaldring 61, 70569 Stuttgart, Germany 3 Institut für Angewandte Materialien-MMS, - Karlsruher Institut für…
Tainã Coleman, Henri Casanova, Loïc Pottier, Manav Kaushik + 2 more
'Ewa Deelman' 'Rafael Ferreira da Silva'] Abstract—Scientific workflows are a cornerstone of modern scientific computing. They are used to describe complex computational applications that require efficient and robust management of large volumes of data, which are typically stored/processed on heterogeneous, distributed…
Alejandro Duque, Abdullah Syed, Kastan V. Day, Matthew J. Berry + 2 more
'Daniel S. Katz' 'Volodymyr Kindratenko'] The recent development of large language models (LLMs) with multi-billion parameters, coupled with the creation of user-friendly application programming interfaces (APIs), has paved the way for automatically generating and executing code in response to straightforward human…
Berk Ekmekci, Charles E. McAnany, Cameron Mura
Computing has revolutionized the biological sciences over the past several decades, such that virtually all contemporary research in molecular biology, biochemistry, and other biosciences utilizes computer programs. The computational advances have come on many fronts, spurred by fundamental developments in hardware…