22 papers · ranked by Valyu relevance
Timothy M Errington, Maya Mathur, Courtney K Soderberg, Alexandria Denis + 5 more
'Alexandria Denis' 'Nicole Perfito' 'Elizabeth Iorns' 'Brian A Nosek' 'Renata Pasqualini' 'Eduardo Franco'] Replicability is an important feature of scientific research, but aspects of contemporary research culture, such as an emphasis on novelty, can make replicability seem less important than it should be. The…
Stahel, Werner A.
Empirical science needs to be based on facts and claims that can be reproduced. This calls for replicating the studies that proclaim the claims, but practice in most fields still fails to implement this idea. When such studies emerged in the past decade, the results were generally disappointing. There have been an…
Michał Sikorski, Mattia Andreoletti
Replicability is widely regarded as one of the defining features of science and its pursuit is one of the main postulates of meta-research, a discipline emerging in response to the replicability crisis. At the same time, replicability is typically treated with caution by philosophers of science. In this paper, we…
Edward Raff, Michel Benaroch, Sagar Samtani, Andrew Farris
The concern that Artificial Intelligence (AI) and Machine Learning (ML) are entering a "reproducibility crisis" has spurred significant research in the past few years. Yet with each paper, it is often unclear what someone means by "reproducibility". Our work attempts to clarify the scope of "reproducibility" as…
Berna Devezer, Erkan O. Buzbas
Replication studies estimate the replicability rate of scientific results by aggregating binary verdicts of experiments. Exact replications are rarely attainable, so most replication sequences are non-exact. Experiments differ in ways that matter and do not share a single data-generating process. We formalize two…
K. Luijken, A. Lohmann, U. Alter, J. Claramunt Gonzalez + 12 more
'F. J. Clouth' 'J. L. Fossum' 'L. Hesen' 'A. H. J. Huizing' 'J. Ketelaar' 'A. K. Montoya' 'L. Nab' 'R. C. C. Nijman' 'B. B. L. Penning de Vries' 'T. D. Tibbe' 'Y. A. Wang' 'R. H. H. Groenwold'] Results of simulation studies evaluating the performance of statistical methods can have a major impact on the way empirical…
Joseph Lemaitre, Désirée Popelka, Blandine Ribotta, Hannah Westlake + 8 more
The ReproSci project retrospectively analyzed the conceptual replicability of 1006 claims from 400 papers published between 1959 and 2011 in the field of Drosophila immunity. This project attempts to provide a comprehensive assessment, 14 years later, of the replicability of nearly all publications across an entire…
Kim Luijken, Adolf W. Lohmann, Udi Alter, J. Claramunt Gonzalez + 12 more
'Felix J. Clouth' 'Jessica Fossum' 'L. Hesen' 'A. H. J. Huizing' 'J. Α. Α. Ketelaar' 'Amanda Kay Montoya' 'Linda Nab' 'R. C. C. Nijman' 'Bas B. L. Penning de Vries' 'Tristan Tibbe' 'Alex Wang' 'Rolf H. H. Groenwold'] Results of simulation studies evaluating the performance of statistical methods are often considered…
Nate Breznau, Eike Mark Rinke, Alexander Wuttke, Muna Adem + 181 more
'Jule Adriaans' 'Esra Akdeniz' 'Amalia Alvarez-Benjumea' 'Henrik K. Andersen' 'Daniel Auer' 'Flavio Azevedo' 'Oke Bahnsen' 'Ling Bai' 'Dave Balzer' 'Paul C. Bauer' 'Gerrit Bauer' 'Markus Baumann' 'Sharon Baute' 'Verena Benoit' 'Julian Bernauer' 'Carl Berning' 'Anna Berthold' 'Felix S. Bethke' 'Thomas Biegert'…
Joseph Lemaitre, Désirée Popelka, Blandine Ribotta, Hannah Westlake + 8 more
The ReproSci project retrospectively analyzed the reproducibility of 1006 claims from 400 papers published between 1959 and 2011 in the field of Drosophila immunity. This project attempts to provide a comprehensive assessment, 14 years later, of the replicability of nearly all publications across an entire scientific…
Stavros I. Dimitriadis, Vignayanandam Ravindernath Muddapu, Roberto Guidotti
One of the key ingredients of scientific progress is the ability to repeat, replicate, and reproduce independently important scientific findings. Recently, independent groups failed to replicate the results of several experiments in various research areas, opening the so-called “reproducibility crisis.” The reasons…
Jean Peccoud, Derek Johnson, Samuel Peccoud, Julia Setchell + 1 more
Reproducibility is the cornerstone of scientific experiments. Assessing the reproducibility of an experiment requires analyzing the contribution of different factors to the variation of the observed data. Suitable data structures need to be defined prior to the data collection effort so that data associated with these…
Erkan Buzbas, Berna Devezer
A core problem that has been addressed in the scientific reform movement so far is the low rates of reproducibility of research results. Mainstream reform literature aimed at increasing reproducibility rates by implementing changes in research practice and scientific policy. At the sidelines of reform, theoreticians…
Abhyuday Desai, Mohamed Abdel‐Hamid, Nakul R. Padalkar
Research? Authors: ['Abhyuday Desai' 'Mohamed Abdel‐Hamid' 'Nakul R. Padalkar'] In the rapidly evolving fields of Artificial Intelligence (AI) and Machine Learning (ML), the reproducibility crisis underscores the urgent need for clear validation methodologies to maintain scientific integrity and encourage advancement.…
Maurice Whelan, Eann Patterson
Reproducibility is essential for innovation but is often hard to achieve in practice. One reason for this is a lack of appreciation of what needs to be reproduced and how in each phase of the innovation process. In the discovery phase, conclusions need to be reproduced through orthogonal investigation. In the…
Milton Gomez, Tom Beucler
While extensive guidance exists for ensuring the reproducibility of one's own study, there is little discussion regarding the reproduction and replication of external studies within one's own research. To initiate this discussion, drawing lessons from our experience reproducing an operational product for predicting…
Erkan O. Buzbas, Berna Devezer, Bert Baumgaertner
The scientific reform movement has proposed openness as a potential remedy to the putative reproducibility or replication crisis. However, the conceptual relationship between openness, replication experiments, and results reproducibility has been obscure. We analyze the logical structure of experiments, define the…
Omer Markovitch, Juntian Wu, Otto Sijbren
Copying information is vital for life's propagation. Current life forms maintain a low error rate in replication using complex machinery to prevent and correct errors. However, primitive life had to deal with higher error rates, limiting its ability to evolve. Discovering mechanisms to reduce errors would alleviate…
Kelly D Cobey, Christophe A Fehlmann, Marina Christ Franco, Ana Patricia Ayala + 12 more
The primary objective of this study was to describe the characteristics of reproducibility studies, including how reproducibility is defined and assessed. We found 47 individual documents reporting reproducibility studies in 2018-2019 that met our inclusion criteria. Our included documents reported 177 individual…
Amit Kahana, Lior Segev, Doron Lancet
The origin of life must have involved an unlikely transition from chaotic chemistry to reproducing supramolecular structures. Previous quantitative analyses of reproducing mutually catalytic networks made of simple molecules have led to increasing popularity of this pre-RNA scenario for life’s origin. Here, we…
Ruben Sanchez-Garcia, Dávid Havasi, Gergely Takács, Matthew C. Robinson + 3 more
Compound availability is a critical property for design prioritization across the drug discovery pipeline. Historically, and despite their multiple limitations, compound-oriented synthetic accessibility scores have been used as proxies for this problem. However, the size of the catalogues of commercially available…
Authors not listed
This paper addresses the challenges in cell line development (CLD), the lengthy and ambiguous clone screening in upstream biopharmaceutical production. Typically, only a small subset of the later stages of CLD data is used for manually selecting lead clones. Addressing this issue, we introduce a multivariate data…