25 papers · ranked by Valyu relevance
Nicholas Scurich, Thomas D. Albright
Proficiency testing is widely used to assess expertise in medicine, engineering, and other high-stakes fields. In forensic science, such tests are often cited in court as evidence that pattern-comparison methods are accurate and reliable. Yet, the scientific value of proficiency testing depends on test design, scoring…
Leszek Konopski, Pingfeng Liu, Wuri Wuryani, Maciej Śliwakowski
An overview of general strategy, standard procedures, and critical points, which may be found during carrying out an OPCW Proficiency Test concerning detection and identification of scheduled compounds relevant to Chemical Weapon Convention, has been presented. The observations have been illustrated following the case…
Geraldine Jeckeln, Ying Hu, Jacqueline G. Cavazos, Amy N. Yates + 4 more
Face identification is a critical element of law enforcement and criminal justice in the United States and abroad. This important task is carried out by professional forensic face examiners. Therefore, it is incumbent on the justice system to ensure that professional face examiners exhibit optimal performance on…
Amidou Diarra, Issa Nébié, Noëlie Béré Henry, Alphonse Ouédraogo + 4 more
Background: The clinical research laboratory plays a pivotal role in the execution of clinical studies. The accurate and consistent registration of patients is dependent on the competent use of laboratory equipment and manual techniques by technicians, ensuring the reliability of the data collected. To support these…
Géraldine Jeckeln, Ying Hu, Jacqueline G. Cavazos, Amy N. Yates + 4 more
'Carina A. Hahn' 'Liansheng Tang' 'P. Jonathon Phillips' 'Alice J. O’Toole'] Measures of face-identification proficiency are essential to ensure accurate and consistent performance by professional forensic face examiners and others who perform face-identification tasks in applied scenarios. Current proficiency tests…
Yevgeni Berzak, Boris Katz, Roger Lévy
We present a novel approach for determining learners' second language proficiency which utilizes behavioral traces of eye movements during reading. Our approach provides standalone eyetracking based English proficiency scores which reflect the extent to which the learner's gaze patterns in reading are similar to those…
Qixiang Fang, Daniel L. Oberski, Dong Nguyen
Case Study of Mathematics Proficiency Authors: ['Qixiang Fang' 'Daniel L. Oberski' 'Dong Nguyen'] Many existing benchmarks of large (multimodal) language models (LLMs) focus on measuring LLMs' academic proficiency, often with also an interest in comparing model performance with human test takers. While these benchmarks…
Reiko Aoki, Dorival Leão, Juan Pablo Mamani Bustamante, Filidor V. Labra
'Filidor V. Labra'] Abstract. Proficiency Testing (PT) determines the performance of individual laboratories for specific tests or measurements and it is used to monitor the reliability of laboratories measurements. PT plays a highly valuable role as it provides an objective evidence of the competence of the…
Susanne Karlsmose Pedersen, Jaap A. Wagenaar, Håkan Vigre, Louise Roer + 5 more
Campylobacter spp. are food- and water borne pathogens. While rather accurate estimates for these pathogens are available in industrialized countries, a lack of diagnostic capacity in developing countries limits accurate assessments of prevalence in many regions. Proficiency in the identification and susceptibility…
Douglas De Rizzo Meneghetti, Plínio Thomaz Aquino
This paper presents catsim, the first package written in the Python language specialized in computerized adaptive tests and the logistical models of Item Response Theory. catsim provides functions for generating item and examinee parameters, simulating tests and plotting results, as well as enabling end users to create…
Duy Anh Nguyen
Recent automated essay scoring (AES) studies increasingly use pretrained transformer models, but these models are usually pretrained on general-domain English and may under-represent second-language learner writing. This study investigates whether domain-adaptive continued pretraining (DAPT) on the EFCAMDAT learner…
Edgar C. Merkle, Nikolay Angelov, Shimin Zhu, Ezra Karger + 2 more
'Philip E. Tetlock' 'Mark Himmelstein'] Assessing forecasting proficiency is a time-intensive activity, often requiring us to wait months or years before we know whether or not the reported forecasts were good. In this study, we develop adaptive cognitive tests that predict forecasting proficiency without the need to…
Lily N. C. Law, Marcel Zentner, Joel Snyder
A common approach for determining musical competence is to rely on information about individuals’ extent of musical training, but relying on musicianship status fails to identify musically untrained individuals with musical skill, as well as those who, despite extensive musical training, may not be as skilled. To…
VANIA FONTANELLA, MARIA CELESTE MORITA
The authors debate the arguments presented in the editorial “Reflections on the current context and evaluation of undergraduate medical education”, bringing the context that culminated in the recent application of the National Proficiency Exam in Dentistry.
Tobias Todsen, Anne Bohr, Lisette Hvid Hovgaard, Rebekka Consuelo Eið + 8 more
Proper specimen collection is the most important step to ensure accurate testing for the coronavirus disease 2019 (COVID-19) and other infectious diseases. Assessment of healthcare workers’ upper respiratory tract specimen collection skills is needed to ensure samples of high-quality clinical specimens for COVID-19…
Katrin Schüttpelz-Brauns, Martina Kadmon, Claudia Kiessling, Yassin Karay + 2 more
'Yassin Karay' 'Margarita Gestmann' 'Juliane E. Kämmer'] Background Low-stakes tests are becoming increasingly important in international assessments of educational progress, and the validity of these results is essential especially as these results are often used for benchmarking. Test scores in these tests not only…
Catherine A. Hogan, Natasha Garamani, Andrew S. Lee, Jack K. Tung + 5 more
Several point-of-care (POC) molecular tests have received emergency use authorization (EUA) from the Food and Drug Administration (FDA) for diagnosis of SARS-CoV-2. The test performance characteristics of the Accula (Mesa Biotech) SARS-CoV-2 POC test need to be evaluated to inform its optimal use. The aim of this study…
Haopeng Chen, Pieter Verbeke, Stefania Mattioni, Cristian Buc Calderon + 1 more
Testing enhances memory more than studying. Although numerous studies have demonstrated the robustness of this classic effect, its neural and computational origin remains debated. Predictive learning is a potential mechanism behind this phenomenon: Because predictions and prediction errors (mismatch between predictions…
Benjamin Neely, Yasset Perez-Riverol, Magnus Palmblad
The past decade has seen widespread advances in quality control (QC) materials and software tools focused specifically on mass spectrometry-based proteomics, yet the rate of adoption is inconsistent. Despite the fundamental importance of QC, it typically falls behind learning new techniques, instruments, or software.…
Marie C. Smithgall, Ioana Scherberkova, Susan Whittier, Daniel A. Green
The SARS-CoV-2 pandemic has created an urgent and unprecedented need for rapid large-scale diagnostic testing to inform timely patient management. This study compared two recently-authorized rapid tests, Cepheid Xpert Xpress SARS-CoV-2 and Abbott ID Now SARS-CoV-2 to the Roche cobas SARS-CoV-2 assay. A total of 113…
Szu Szu Ling, Fabrice Saffre, Deborah L. Gater, Lilia Halim + 1 more
Computer quiz games are introduced to improve teaching and learning in a freshman engineering chemistry course in an English-as-a-Second-Language (ESL) environment. These quiz games are developed and implemented as a supplemental and augmentative tool to enhance traditionally delivered lectures. The paper shows an…
Qianxin Wu, Chenqu Suo, Tom Brown, Tengyao Wang + 2 more
We present INSIGHT (Isothermal NASBA-Sequencing-based hIGH-througput Test): a two-stage COVID-19 testing strategy, using a barcoded isothermal NASBA reaction that combines point-of-care diagnosis with next generation sequencing, aiming to achieve population-scale COVID-19 testing. INSIGHT combines the advantages of…
Pragadeeshwara Rao R
Due to the ongoing concern for the development of rapid and accurate antimicrobial susceptibility testing (AST) methods in the field of clinical microbiology, several novel AST systems have been developed to replace the traditional gold standard AST techniques, which are time-consuming and can lead to delayed…
Fayyaz Minhas, Dimitris Grammatopoulos, Lawrence Young, Imran Amin + 4 more
One of the challenges in the current COVID-19 crisis is the time and cost of performing tests especially for large-scale population surveillance. Since, the probability of testing positive in large population studies is expected to be small (<15%), therefore, most of the test outcomes will be negative. Here, we propose…
Matthias Täufer
Pooling of samples can increase lab capacity when using Polymerase chain reaction (PCR) to detect diseases such as COVID-19. However, pool testing is typically performed via an adaptive testing strategy which requires a feedback loop in the lab and at least two PCR runs to confirm positive results. This can cost…