12 papers · ranked by Valyu relevance
Masanao Ozawa, Andrei Khrennikov
Recently, quantum formalism started to be actively used outside of quantum physics: in psychology, decision-making, economics, finances, and social science. Human psychological behavior is characterized by a few basic effects; one of them is the question order effect (QOE). This effect was successfully modeled…
Brian A. Nosek, Timothy M. Errington
Credibility of scientific claims is established with evidence for their replicability using new data. According to common understanding, replication is repeating a study’s procedure and observing whether the prior finding recurs. This definition is intuitive, easy to apply, and incorrect. We propose that replication is…
Denitsa Saynova, Kajsa Hansson, Bastiaan Bruinsma, Annika Fredén + 1 more
'Moa Johansson'] In this study, we investigate whether LLMs can be used to indicate if a study in the behavioural social sciences is replicable. Using a dataset of 14 previously replicated studies (9 successful, 5 unsuccessful), we evaluate the ability of both open-source (Llama 3 8B, Qwen 2 7B, Mistral 7B) and…
Michał Sikorski, Mattia Andreoletti
Replicability is widely regarded as one of the defining features of science and its pursuit is one of the main postulates of meta-research, a discipline emerging in response to the replicability crisis. At the same time, replicability is typically treated with caution by philosophers of science. In this paper, we…
Michael Gordon, Domenico Viganola, Anna Dreber, Magnus Johannesson + 1 more
'Thomas Pfeiffer'] The reproducibility of published research has become an important topic in science policy. A number of large-scale replication projects have been conducted to gauge the overall reproducibility in specific academic fields. Here, we present an analysis of data from four studies which sought to forecast…
Bonnie C. Wintle, Eden T. Smith, Martin Bush, Fallon Mody + 15 more
'David P. Wilkinson' 'Anca M. Hanea' 'Alexandru Marcoci' 'Hannah Fraser' 'Victoria Hemming' 'Felix Singleton Thorn' 'Marissa F. McBride' 'Elliot Gould' 'Andrew Head' 'Daniel G. Hamilton' 'Steven Kambouris' 'Libby Rumpff' 'Rink Hoekstra' 'Mark A. Burgman' 'Fiona Fidler'] This paper explores judgements about the…
Jennifer Murphy, Aaron R. Caldwell, Joe P. Warne
This review reflects on the lessons and limitations of the first large, collaborative replication project in sports and exercise science. We discuss the challenges and barriers faced, while also exploring the broader contribution of replication to the field. This project faced many practical challenges when preparing…
Hannah Fraser, Martin Bush, Bonnie C. Wintle, Fallon Mody + 28 more
'Eden T. Smith' 'Anca M. Hanea' 'Elliot Gould' 'Victoria Hemming' 'Daniel G. Hamilton' 'Libby Rumpff' 'David P. Wilkinson' 'Ross Pearson' 'Felix Singleton Thorn' 'Raquel Ashton' 'Aaron Willcox' 'Charles T. Gray' 'Andrew Head' 'Melissa Ross' 'Rebecca Groenewegen' 'Alexandru Marcoci' 'Ans Vercammen' 'Timothy H. Parker'…
Giovanni Parmigiani
In this article I propose an approach for defining replicability for prediction rules. Motivated by a recent NAS report, I start from the perspective that replicability is obtaining consistent results across studies suitable to address the same prediction question, each of which has obtained its own data. I then…
Giampietro Gobo
Replicability is a term that not only comes with different meanings in the literature of many domains but is often associated or confused with other terms such as ‘reproducibility,’ ‘repeatability,’ ‘reliability,’ ‘validity,’ and so on. To add to the confusion, it can even be used differently across diverse…
Weronika Łajewska, Damiano Spina, Johanne R. Trippas, Krisztian Balog
'Krisztian Balog'] The increasing reliance on digital information necessitates advancements in conversational search systems, particularly in terms of information transparency. While prior research in conversational information-seeking has concentrated on improving retrieval techniques, the challenge remains in…
Nir Douer, Joachim Meyer
When humans interact with intelligent systems, their causal responsibility for outcomes becomes equivocal. We analyze the descriptive abilities of a newly developed responsibility quantification model (ResQu) to predict actual human responsibility and perceptions of responsibility in the interaction with intelligent…