24 papers · ranked by Valyu relevance
G.P. Saggese, Paul Smith
| 1. | Introduction | 1 | |----|--------------------------------------------|----| | 2. | DataFlow at a Glance | 6 | | 3. | Challenges in time series machine learning | 7 | | 4. | Semantics | 11 | | 5. | DAGs | 29 | | 6. | Execution Engine | 38 | | 7. | Comparison to Related Work | 47 | | | References | 49 |
Simone Ma, Benson Ncube, Grey Faulkenberry, Audrey Masizana + 2 more
Background Botswana has made significant investments in its health care information infrastructure, including vertical programs for child health and nutrition, HIV care, and tuberculosis. However, effectively integrating the more than 18 systems in place for data collection and reporting has proved to be challenging.…
Charlotte Capitanchik, Sam Ireland, Alex Harston, Chris Cheshire + 13 more
Ever-increasing volumes of sequencing data offer potential for large-scale meta-analyses to address significant biological questions. However, challenges such as insufficient data processing information, data quality concerns, and issues related to accessibility and curation often present obstacles. Additionally, most…
Zijun Li, Chuhao Xu, Quan Chen, Jieru Zhao + 2 more
Serverless computing that runs functions with auto-scaling is a popular task execution pattern in the cloud-native era. By connecting serverless functions into workflows, tenants can achieve complex functionality. Prior researches adopt the control-flow paradigm to orchestrate a serverless workflow. However, the…
Harald Foidl, Valentina Golendukhina, Rudolf Ramler, Michael Felderer
'Michael Felderer'] Data pipelines are an integral part of various modern data-driven systems. However, despite their importance, they are often unreliable and deliver poor-quality data. A critical step toward improving this situation is a solid understanding of the aspects contributing to the quality of data…
Georgios Makrygiorgos, Aaron J. Berliner, Fengzhe Shi, Douglas S. Clark + 2 more
Computational models are increasingly used to investigate and predict the complex dynamics of biological and biochemical systems. Nevertheless, governing equations of a biochemical system may not be (fully) known, which would necessitate learning the system dynamics directly from, often limited and noisy, observed…
Jennifer M. Schopf, Katrina Turner, Dan Doyle, Andrew Lake + 2 more
'Jason Leigh' 'Brian L. Tierney'] Data sharing is required for research collaborations, but effective data transfer performance continues to be difficult to achieve. The NetSage Measurement and Analysis Framework can assist in understanding research data movement. It collects a broad set of monitoring data and builds…
Faisal Saleem, Alicja Wiora, Józef Wiora
Regulated flow systems exhibit a variable dynamic behavior when subjected to distinct inputs. The significant non-linear behavior of the system at low inputs and the difference in the output pattern for the increase and decrease in flow pose challenges in modeling. One way is to identify separate sets of parameters for…
M. TAMER ÖZSU
Work-in-progressThere has been an increasing recognition of the value of data and of data-based decision making. As a consequence, the development of data science as a field of study has intensified in recent years. However, there is no systematic and comprehensive treatment and understanding of data science. This…
Yue Li, Qunshan Zhao, Mingshu Wang
Traffic flow data has been used in various disciplines, including geography, transportation, urban planning, and public health. However, existing datasets often have limitations such as low spatiotemporal resolution and inconsistent quality due to data collection methods and the need for an adequate data cleaning…
Brian Teague
Cytoflow is a free, open-source flow cytometry toolbox that enables quantitative and reproducible analyses of flow cytometry experiments. Comprised of a set of well-documented Python modules wrapped by a graphical user interface, Cytoflow allows both programmers and bench scientists to apply modern data analysis…
Andrei Paleyes, Christian Cabrera, Neil D. Lawrence
As use of data driven technologies spreads, software engineers are more often faced with the task of solving a business problem using data-driven methods such as machine learning (ML) algorithms. Deployment of ML within large software systems brings new challenges that are not addressed by standard engineering…
Yue Chen, Jian Lu, Zhihong (Arry) Yao
The quality of traffic flow data is very important to the effective management and operation of urban traffic system. At present, most traffic flow data used in traffic flow research come from road sensors, but the shortcomings of long sampling period and sparse sampling points affect the quality control of traffic…
Authors not listed
Self-driving laboratories (SDLs) promise accelerated scientific discovery and product development by closing the loop between robotic execution and AI/ML-driven decision making. In practice, however, SDL orchestration remains fragmented; workflows are typically encoded as laboratory-specific scripts or bespoke…
Md. Abu Bakar Siddik, Kerim E. Dickson, James Rising, Benjamin L. Ruddell + 1 more
'Benjamin L. Ruddell' 'Landon T. Marston'] Interbasin water transfers (IBTs) can have a significant impact on the environment, water availability, and economies within the basins importing and exporting water, as well as basins downstream of these water transfers. The lack of comprehensive data identifying and…
Ashley N. Edelen, Sarah Cashman, Ben Young, Wesley W. Ingwersen
As a fundamental component of data for life cycle assessment models, elementary flows have been demonstrated to be a key requirement of life cycle assessment data interoperability. However, existing elementary flow lists have been found to lack sufficient structure to enable improved interoperability between life cycle…
Jacopo Tartaglia, Mario Giorgioni, Luigi Cattivelli, Primetta Faccioli
Advances in high-throughput DNA sequencing technologies have dramatically reduced the time and cost required to generate genomic data. As sequencing is no longer a limiting factor, increasing attention must be paid to optimizing the analyses of the large-scale datasets produced. Efficient processing of such data is…
Indrė Žliobaitė, Jesse Read
Machine learning from data streams is an active and growing research area. Research on learning from streaming data typically makes strict assumptions linked to computational resource constraints, including requirements for stream mining algorithms to inspect each instance not more than once and be ready to give a…
Mahnoor Zulfiqar, Michael R. Crusoe, Birgitta König-Ries, Christoph Steinbeck + 2 more
Scientific workflows facilitate the automation of data analysis tasks by integrating various software and tools executed in a particular order. To enable transparency and reusability in workflows, it is essential to implement the FAIR principles. Here, we describe our experiences implementing the FAIR principles for…
Boris Yamrom, Yoon-ha Lee, Steven Marks, Lubomir Chorbadjiev + 2 more
Snakemake is one of the most popular workflow management systems, particularly in biological sciences. Snakemake workflows are highly portable, scalable, and transparent. Moreover, they enable the painless reproduction of published results and adaption to similar data processing and analysis projects. Here we present…
Daniel J.B. Clarke, John Erol Evangelista, Zhuorui Xie, Giacomo B. Marino + 36 more
Many biomedical research projects produce large-scale datasets that may serve as resources for the research community for hypothesis generation, facilitating diverse use cases. Towards the goal of developing infrastructure to support the findability, accessibility, interoperability, and reusability (FAIR) of biomedical…
Aleksandar Jagličić, Torben Gädt, Matthias Hofmann
Isothermal heat flow calorimetry is a powerful method for studying chemical processes. In cement research, it has become indispensable for quantifying the heat release during cement hydration. It is used to study the reactivity of cementitious binders and the effect of admixture chemistry and dosage. Most isothermal…
Olukayode Majekodunmi, Sara Hashmi
In suspension flows through microchannels with parallel walls, rigid particles form clogs that grow continuously in the upstream direction. However, introducing a slight taper to channel walls leads to a qualitatively different clogging mechanism. Clogs of rigid particles do not grow continuously in these tapered…
Authors not listed
Real-world datasets in chemical engineering and bioengineering processes--such as those from catalytic reactors, multiphase flows, polymerization reactors, bioreactors, and clinical trials--can often be unlabelled or disorganized, rendering the training of existing supervised learning models ineffective at learning the…