13 papers · ranked by Valyu relevance
Lesley A. Alton, Candice L. Bywater, Elia Pirtle, Michael R. Kearney + 1 more
Science is often claimed to be amid a reproducibility crisis, as evidenced by low replicability of many classic findings across multiple fields. Yet it is not clear how widespread this purported problem is. Physiological responses have the potential for replicability issues because of laboratory-specific biases in…
Monia Ranalli, Yafei Lyu, Hillary Koch, Qunhua Li
Replication is essential to reliable and consistent scientific discovery in high-throughput experiments. Quantifying the replicability of scientific discoveries and identifying sources of irreproducibility have become important tasks for quality control and data integration. In this work we introduce a novel…
Peng Wang, Hongyuan Cao, Xiaoquan Wen, Macha Nikolski
We further extend (0-3)$(1)$ to model observed effects, along with the corresponding standard errors. The resulting hierarchical model, incorporating a user-defined $P_{\text{mis}}$ threshold, fully characterizes the properties of replicable signals given a group of estimated effects and their corresponding standard…
Raviteja Kotikalapudi, Balint Kincses, Giuseppe Gallitto, Robert Englert + 5 more
Replicability of anatomical and functional MRI-based inter-individual BWAS has been extensively discussed recently. This study reports a comprehensive evaluation of BWAS replicability based on structural connectomes (streamlines, FA, MD, RD, AD). Overall, 36%(21/58) of brain-phenotype associations were replicable in…
María Paula Fernández-García, Guillermo Vallejo-Seco, Pablo Livácic-Rojas
The replicability crisis in the behavioral sciences should no longer be understood as a merely technical problem confined to the failure to reproduce specific findings. Rather, it reflects a deeper structural issue: a growing misalignment between data, method, and inference. When these three levels cease to be…
Jan Walleczek, Nikolaus von Stillfried, Stefan Schmidt, Marc Wittmann + 4 more
This metascientific project studied the replicability of Bem Experiment 1, which had claimed a precognitive effect, i.e., the ability to successfully guess the outcome of future random events (Bem. J Pers Soc Psychol. 2011;100: 407−25). The use of advanced methodologies-based on the advanced meta-experimental protocol…
Rita Banzi, Monika Varga, Yuri Andrei Gelsleichter, Constant Vinatier + 2 more
Evidence-based solutions are needed to help improve reproducibility in research. This Consensus View presents a consensus-based list of core reproducibility items for research that has been developed by a multidisciplinary group interested in research, open science, and reproducibility. The set of minimum requirements…
Tommaso Costa
Across psychology, bold empirical claims often outpace the evidential support on which they rest. The replication crisis has shown that statistical significance alone provides little guidance about what should rationally be believed. To address this gap between results and rhetoric, we introduce the Bayesian audit-a…
Jonna Brenninkmeijer, Maarten Derksen, Stephanie Meirmans, Jeannette Pols
Ethnography and other empirical studies of replication played a significant role in the sociology of scientific knowledge (SSK) during the 1970s and 1980s. Collins and other proponents of SSK highlighted that exact replication was impossible, knowledge was often tacit and hard to explicate, and that results were always…
Lorraine Buis, Armaan Jamal, Clarence Baxter, Arthur A Stone + 3 more
Intensive, repeated self-report measures are an important tool for behavioral and medical researchers and practitioners who are concerned with the dynamic interplay among variables at a granular level. Many mobile health applications rely on accurate measurement of immediate states and environments for both assessment…
Brian A. Nosek, David B. Allison, Kathleen Hall Jamieson, Marcia McNutt + 2 more
Vigorous debate has erupted over the trustworthiness of scientific research findings in a number of domains. The question “what makes research findings trustworthy?” elicits different answers depending on whether the emphasis is on research integrity and ethics, research methods, transparency, inclusion, assessment and…
Alina Ahrens, Heinrich R. Liesefeld, Jule Kinner, Markus Janczyk
In everyday life, we often generalize previously learned associations between our actions and their outcomes to novel, but similar situations. The present study aimed to conceptually and directly replicate results reported by Esser et al. (Psychological Research, 87(7), 2249-2258 [14]), who reported that action-effect…
Noam Karsh
Introduction Agency confirmation via control feedback (e.g., an immediate sensory consequence of one’s action) has been shown to motivate action choice and reinforce motor responses. Recent work also demonstrated that it qualitatively improves motor performance. The present study tested the hypothesis that this…