11 papers · ranked by Valyu relevance
Zeyi Wang, Eric Bridgeford, Shangsi Wang, Joshua T Vogelstein + 1 more
'Brian Caffo'] - Abstract. The advent of modern data collection and processing techniques has seen the size, scale, and complexity of data grow exponentially. A seminal step in leveraging these rich datasets for downstream inference is understanding the characteristics of the data which are repeatable – the aspects of…
Wojciech H. Zurek
Unknown quantum state of a single system cannot be discovered as a measured system is reprepared – it jumps into an eigenstate of the measured observable. This impossibility to find out a quantum state and other symptoms usually blamed on the wavepacket collapse follow (as was recently demonstrated for pure states of…
Alan H. Dorfman, Richard Valliant
Forensic firearms identification, the determination by a trained firearms examiner as to whether or not bullets or cartridges came from a common weapon, has long been a mainstay in the criminal courts. Reliability of forensic firearms identification has been challenged in the general scientific community, and, in…
Andréanne Lemay, Katharina Hoebel, Christopher P. Bridge, Brian Befano + 6 more
'Brian Befano' 'Sílvia de Sanjosé' 'Diden Egemen' 'Ana Cecilia Rodríguez' 'Mark Schiffman' 'J. Peter Campbell' 'Jayashree Kalpathy-Cramer'] The integration of artificial intelligence into clinical workflows requires reliable and robust models. Repeatability is a key attribute of model robustness. Repeatable models…
Shoaib Ehsan, Nadia Kanwal, Adrian F. Clark, Klaus D. McDonald-Maier
The most frequently employed measure for performance characterization of local feature detectors is repeatability, but it has been observed that this does not necessarily mirror actual performance. In this letter, improved repeatability formulations are presented which correlate much better with the true performance of…
Anja Belz
Reproducibility has become an intensely debated topic in NLP and ML over recent years, but no commonly accepted way of assessing reproducibility, let alone quantifying it, has so far emerged. The assumption has been that wider scientific reproducibility terminology and definitions are not applicable to NLP/ML, with the…
Andréanne Lemay, Katharina Hoebel, Christopher P. Bridge, Didem Egemen + 4 more
'Didem Egemen' 'Ana Cecilia Rodríguez' 'Mark Schiffman' 'J. Peter Campbell' 'Jayashree Kalpathy-Cramer'] The integration of artificial intelligence into clinical workflows requires reliable and robust models. Among the main features of robustness is repeatability. Much attention is given to classification performance…
Anh-Dzung Doan, Daniyar Turmukhambetov, Yasir Latif, Tat-Jun Chin + 1 more
'Soohyun Bae'] Abstract— Many robotics applications require interest points that are highly repeatable under varying viewpoints and lighting conditions. However, this requirement is very challenging as the environment changes continuously and indefinitely, leading to appearance changes of interest points with respect…
Odd Erik Gundersen
Reproducibility is a confused terminology. In this paper, I take a fundamental view on reproducibility rooted in the scientific method. The scientific method is analysed and characterised in order to develop the terminology required to define reproducibility. Further, the literature on reproducibility and replication…
Napa Sae-Bae, Nasir Memon, Pitikhate Sooraksa
This paper proposes three measures to quantify the characteristics of online signature templates in terms of distinctiveness, complexity and repeatability. A distinctiveness measure of a signature template is computed from a set of enrolled signature samples and a statistical assumption about random signatures.…
Edward Raff, Michel Benaroch, Sagar Samtani, Andrew Farris
The concern that Artificial Intelligence (AI) and Machine Learning (ML) are entering a "reproducibility crisis" has spurred significant research in the past few years. Yet with each paper, it is often unclear what someone means by "reproducibility". Our work attempts to clarify the scope of "reproducibility" as…