21 papers · ranked by Valyu relevance
Masanao Ozawa, Andrei Khrennikov
Recently, quantum formalism started to be actively used outside of quantum physics: in psychology, decision-making, economics, finances, and social science. Human psychological behavior is characterized by a few basic effects; one of them is the question order effect (QOE). This effect was successfully modeled…
Brian A. Nosek, Timothy M. Errington
Credibility of scientific claims is established with evidence for their replicability using new data. According to common understanding, replication is repeating a study’s procedure and observing whether the prior finding recurs. This definition is intuitive, easy to apply, and incorrect. We propose that replication is…
Denitsa Saynova, Kajsa Hansson, Bastiaan Bruinsma, Annika Fredén + 1 more
'Moa Johansson'] In this study, we investigate whether LLMs can be used to indicate if a study in the behavioural social sciences is replicable. Using a dataset of 14 previously replicated studies (9 successful, 5 unsuccessful), we evaluate the ability of both open-source (Llama 3 8B, Qwen 2 7B, Mistral 7B) and…
Joseph Lemaitre, Désirée Popelka, Blandine Ribotta, Hannah Westlake + 8 more
The ReproSci project retrospectively analyzed the conceptual replicability of 1006 claims from 400 papers published between 1959 and 2011 in the field of Drosophila immunity. This project attempts to provide a comprehensive assessment, 14 years later, of the replicability of nearly all publications across an entire…
Michał Sikorski, Mattia Andreoletti
Replicability is widely regarded as one of the defining features of science and its pursuit is one of the main postulates of meta-research, a discipline emerging in response to the replicability crisis. At the same time, replicability is typically treated with caution by philosophers of science. In this paper, we…
Joseph Lemaitre, Désirée Popelka, Blandine Ribotta, Hannah Westlake + 8 more
The ReproSci project retrospectively analyzed the reproducibility of 1006 claims from 400 papers published between 1959 and 2011 in the field of Drosophila immunity. This project attempts to provide a comprehensive assessment, 14 years later, of the replicability of nearly all publications across an entire scientific…
Bernhard Voelkl, Hanno Würbel
Reproducibility in biomedical research, and more specifically in preclinical animal research, has been seriously questioned. Several cases of spectacular failures to replicate findings published in the primary scientific literature have led to a perceived reproducibility crisis. Diverse threats to reproducibility have…
Michael Gordon, Domenico Viganola, Anna Dreber, Magnus Johannesson + 1 more
'Thomas Pfeiffer'] The reproducibility of published research has become an important topic in science policy. A number of large-scale replication projects have been conducted to gauge the overall reproducibility in specific academic fields. Here, we present an analysis of data from four studies which sought to forecast…
Bonnie C. Wintle, Eden T. Smith, Martin Bush, Fallon Mody + 15 more
'David P. Wilkinson' 'Anca M. Hanea' 'Alexandru Marcoci' 'Hannah Fraser' 'Victoria Hemming' 'Felix Singleton Thorn' 'Marissa F. McBride' 'Elliot Gould' 'Andrew Head' 'Daniel G. Hamilton' 'Steven Kambouris' 'Libby Rumpff' 'Rink Hoekstra' 'Mark A. Burgman' 'Fiona Fidler'] This paper explores judgements about the…
Jennifer Murphy, Aaron R. Caldwell, Joe P. Warne
This review reflects on the lessons and limitations of the first large, collaborative replication project in sports and exercise science. We discuss the challenges and barriers faced, while also exploring the broader contribution of replication to the field. This project faced many practical challenges when preparing…
Hannah Fraser, Martin Bush, Bonnie C. Wintle, Fallon Mody + 28 more
'Eden T. Smith' 'Anca M. Hanea' 'Elliot Gould' 'Victoria Hemming' 'Daniel G. Hamilton' 'Libby Rumpff' 'David P. Wilkinson' 'Ross Pearson' 'Felix Singleton Thorn' 'Raquel Ashton' 'Aaron Willcox' 'Charles T. Gray' 'Andrew Head' 'Melissa Ross' 'Rebecca Groenewegen' 'Alexandru Marcoci' 'Ans Vercammen' 'Timothy H. Parker'…
Giovanni Parmigiani
In this article I propose an approach for defining replicability for prediction rules. Motivated by a recent NAS report, I start from the perspective that replicability is obtaining consistent results across studies suitable to address the same prediction question, each of which has obtained its own data. I then…
Giampietro Gobo
Replicability is a term that not only comes with different meanings in the literature of many domains but is often associated or confused with other terms such as ‘reproducibility,’ ‘repeatability,’ ‘reliability,’ ‘validity,’ and so on. To add to the confusion, it can even be used differently across diverse…
Evanthia Kaimaklioti Samota, Robert P. Davey
We constructed a survey to understand how authors and scientists view the issues around reproducibility, focusing on interactive elements such as interactive figures embedded within online publications, as a solution for enabling the reproducibility of experiments. We report the views of 251 researchers, comprising…
Weronika Łajewska, Damiano Spina, Johanne R. Trippas, Krisztian Balog
'Krisztian Balog'] The increasing reliance on digital information necessitates advancements in conversational search systems, particularly in terms of information transparency. While prior research in conversational information-seeking has concentrated on improving retrieval techniques, the challenge remains in…
Lore WE Vleugels, Stephan P Swinnen, Robert M Hardwick
Developing approaches to improve motor skill learning is of considerable interest across multiple disciplines. Previous research has typically shown that repeating the same action on consecutive trials enhances short-term performance, but has detrimental effects on longer term skill acquisition. However, most prior…
Nir Douer, Joachim Meyer
When humans interact with intelligent systems, their causal responsibility for outcomes becomes equivocal. We analyze the descriptive abilities of a newly developed responsibility quantification model (ResQu) to predict actual human responsibility and perceptions of responsibility in the interaction with intelligent…
Amit Kahana, Lior Segev, Doron Lancet
The origin of life must have involved an unlikely transition from chaotic chemistry to reproducing supramolecular structures. Previous quantitative analyses of reproducing mutually catalytic networks made of simple molecules have led to increasing popularity of this pre-RNA scenario for life’s origin. Here, we…
Authors not listed
Ensuring the trustworthiness of machine learning (ML) models in high-stake applications is crucial. One such application is predicting anti-cancer drug sensitivity, where ML models are built with the final goal of integrating them into treatment recommendation systems for personalized medicine. Here, we propose a…
Authors not listed
The value of generative artificial intelligence (AI) for teaching and learning is currently hotly debated. Concerns regarding the accuracy of information produced by generative AI as well as student over-reliance on this tool coexist with excitement about tailored opportunities that AI may provide for educational…
Authors not listed
Artificial intelligence, represented by large language models (LLMs), has demonstrated tremendous capabilities in natural language recognition and extraction. To further evaluate the performance of various LLMs in extracting information from academic papers, this study explores the application of LLMs in reticular…