28 papers · ranked by Valyu relevance
Brian A. Nosek, Timothy M. Errington
Credibility of scientific claims is established with evidence for their replicability using new data. According to common understanding, replication is repeating a study’s procedure and observing whether the prior finding recurs. This definition is intuitive, easy to apply, and incorrect. We propose that replication is…
Timothy M Errington, Maya Mathur, Courtney K Soderberg, Alexandria Denis + 5 more
'Alexandria Denis' 'Nicole Perfito' 'Elizabeth Iorns' 'Brian A Nosek' 'Renata Pasqualini' 'Eduardo Franco'] Replicability is an important feature of scientific research, but aspects of contemporary research culture, such as an emphasis on novelty, can make replicability seem less important than it should be. The…
Michał Sikorski, Mattia Andreoletti
Replicability is widely regarded as one of the defining features of science and its pursuit is one of the main postulates of meta-research, a discipline emerging in response to the replicability crisis. At the same time, replicability is typically treated with caution by philosophers of science. In this paper, we…
Marcin Miłkowski, Witold M. Hensel, Mateusz Hohol
Replicability and reproducibility of computational models has been somewhat understudied by “the replication movement.” In this paper, we draw on methodological studies into the replicability of psychological experiments and on the mechanistic account of explanation to analyze the functions of model replications and…
Edward Raff, Michel Benaroch, Sagar Samtani, Andrew Farris
The concern that Artificial Intelligence (AI) and Machine Learning (ML) are entering a "reproducibility crisis" has spurred significant research in the past few years. Yet with each paper, it is often unclear what someone means by "reproducibility". Our work attempts to clarify the scope of "reproducibility" as…
Prasad Patil, Roger D. Peng, Jeffrey T. Leek
Everyone agrees that reproducibility and replicability are fundamental characteristics of scientific studies. These topics are attracting increasing attention, scrutiny, and debate both in the popular press and the scientific literature. But there are no formal statistical definitions for these concepts, which leads to…
Brian A Nosek, Timothy M Errington
The first results from the Reproducibility Project: Cancer Biology suggest that there is scope for improving reproducibility in pre-clinical cancer research. DOI:[http://dx.doi.org/10.7554/eLife.23383.001]()
Joseph Lemaitre, Désirée Popelka, Blandine Ribotta, Hannah Westlake + 8 more
The ReproSci project retrospectively analyzed the conceptual replicability of 1006 claims from 400 papers published between 1959 and 2011 in the field of Drosophila immunity. This project attempts to provide a comprehensive assessment, 14 years later, of the replicability of nearly all publications across an entire…
Kim Luijken, Adolf W. Lohmann, Udi Alter, J. Claramunt Gonzalez + 12 more
'Felix J. Clouth' 'Jessica Fossum' 'L. Hesen' 'A. H. J. Huizing' 'J. Α. Α. Ketelaar' 'Amanda Kay Montoya' 'Linda Nab' 'R. C. C. Nijman' 'Bas B. L. Penning de Vries' 'Tristan Tibbe' 'Alex Wang' 'Rolf H. H. Groenwold'] Results of simulation studies evaluating the performance of statistical methods are often considered…
Stahel, Werner A.
Empirical science needs to be based on facts and claims that can be reproduced. This calls for replicating the studies that proclaim the claims, but practice in most fields still fails to implement this idea. When such studies emerged in the past decade, the results were generally disappointing. There have been an…
Giampietro Gobo
Replicability is a term that not only comes with different meanings in the literature of many domains but is often associated or confused with other terms such as ‘reproducibility,’ ‘repeatability,’ ‘reliability,’ ‘validity,’ and so on. To add to the confusion, it can even be used differently across diverse…
Joseph Lemaitre, Désirée Popelka, Blandine Ribotta, Hannah Westlake + 8 more
The ReproSci project retrospectively analyzed the reproducibility of 1006 claims from 400 papers published between 1959 and 2011 in the field of Drosophila immunity. This project attempts to provide a comprehensive assessment, 14 years later, of the replicability of nearly all publications across an entire scientific…
Yi Zhao, Xiaoquan Wen
Assessment of replicability is critical to ensure the quality and rigor of scientific research. In this paper, we discuss inference and modeling principles for replicability assessment. Targeting distinct application scenarios, we propose two types of Bayesian model criticism approaches to identify potentially…
Jeffrey T. Leek, Prasad Patil, Roger D. Peng
A recent study of the replicability of key psychological findings is a major contribution toward understanding the human side of the scientific process. Despite the careful and nuanced analysis reported in the paper, mass and social media adhered to the simple narrative that only 36% of the studies replicated their…
Joanna Lewis, Charles E. Breeze, Jane Charlesworth, Oliver J. Maclaren + 1 more
'Oliver J. Maclaren' 'Jonathan Cooper'] Background The concept of reproducibility is a foundation of the scientific method. With the arrival of fast and powerful computers over the last few decades, there has been an explosion of results based on complex computational analyses and simulations. The reproducibility of…
Yang Liu, Michael Gordon, Juntao Wang, Michaël Bishop + 4 more
'Thomas Pfeiffer' 'Charles Twardy' 'Domenico Viganola'] The last decade saw the emergence of systematic large-scale replication projects in the social and behavioral sciences, (Camerer et al., 2016, 2018; Ebersole et al., 2016; Klein et al., 2014, 2018; Collaboration, 2015). These projects were driven by theoretical…
Erkan Buzbas, Berna Devezer
A core problem that has been addressed in the scientific reform movement so far is the low rates of reproducibility of research results. Mainstream reform literature aimed at increasing reproducibility rates by implementing changes in research practice and scientific policy. At the sidelines of reform, theoreticians…
Evanthia Kaimaklioti Samota, Robert P. Davey
We constructed a survey to understand how authors and scientists view the issues around reproducibility, focusing on interactive elements such as interactive figures embedded within online publications, as a solution for enabling the reproducibility of experiments. We report the views of 251 researchers, comprising…
Maurice Whelan, Eann Patterson
Reproducibility is essential for innovation but is often hard to achieve in practice. One reason for this is a lack of appreciation of what needs to be reproduced and how in each phase of the innovation process. In the discovery phase, conclusions need to be reproduced through orthogonal investigation. In the…
Erkan O. Buzbas, Berna Devezer, Bert Baumgaertner
The scientific reform movement has proposed openness as a potential remedy to the putative reproducibility or replication crisis. However, the conceptual relationship between openness, replication experiments, and results reproducibility has been obscure. We analyze the logical structure of experiments, define the…
Odd Erik Gundersen
Reproducibility is a confused terminology. In this paper, I take a fundamental view on reproducibility rooted in the scientific method. The scientific method is analysed and characterised in order to develop the terminology required to define reproducibility. Further, the literature on reproducibility and replication…
Omer Markovitch, Juntian Wu, Otto Sijbren
Copying information is vital for life's propagation. Current life forms maintain a low error rate in replication using complex machinery to prevent and correct errors. However, primitive life had to deal with higher error rates, limiting its ability to evolve. Discovering mechanisms to reduce errors would alleviate…
Bert Baumgaertner, Berna Devezer, Erkan O. Buzbas, Luis G. Nardin
This paper investigates the conceptual relationship between openness and reproducibility using a model-centric approach, heavily informed by probability theory and statistics. We first clarify the concepts of reliability, auditability, replicability, and reproducibility–each of which denotes a potential scientific…
Amit Kahana, Lior Segev, Doron Lancet
The origin of life must have involved an unlikely transition from chaotic chemistry to reproducing supramolecular structures. Previous quantitative analyses of reproducing mutually catalytic networks made of simple molecules have led to increasing popularity of this pre-RNA scenario for life’s origin. Here, we…
Camilla Kao, Che-I Kao, Russell Furr
In science, safety can seem unfashionable. Satisfying safety requirements can slow the pace of research, make it cumbersome, or cost significant amounts of money. The logic of rules can seem unclear. Compliance can feel like a negative incentive. So besides the obvious benefit that safety keeps one safe, why do some…
Camilla Kao, Che-I Kao, Russell Furr
In science, safety can seem unfashionable. Satisfying safety requirements can slow the pace of research, make it cumbersome, or cost significant amounts of money. The logic of rules can seem unclear. Compliance can feel like a negative incentive. So besides the obvious benefit that safety keeps one safe, why do some…
Camilla Kao, Che-I Kao, Russell Furr
In science, safety can seem unfashionable. Satisfying safety requirements can slow the pace of research, make it cumbersome, or cost significant amounts of money. The logic of rules can seem unclear. Compliance can feel like a negative incentive. So besides the obvious benefit that safety keeps one safe, why do some…
Authors not listed
This paper addresses the challenges in cell line development (CLD), the lengthy and ambiguous clone screening in upstream biopharmaceutical production. Typically, only a small subset of the later stages of CLD data is used for manually selecting lead clones. Addressing this issue, we introduce a multivariate data…