26 papers · ranked by Valyu relevance
Florian Bordes, Candace Ross, Justine T Kao, Evangelia Spiliopoulou + 1 more
The rapid proliferation of benchmarks has created significant challenges in reproducibility, transparency, and informed decision-making. However, unlike datasets and models—which benefit from structured documentation frameworks like Datasheets and Model Cards—evaluation methodologies lack systematic documentation…
Hongxiao Li, Chenxi Wang, Fanda Fan, Zihan Wang + 3 more
Evaluation is the foundation of empirical science, yet the evaluation of evaluation itself – so-called meta-evaluation – remains strikingly underdeveloped. While methods such as observational studies, design of experiments (DoE), and randomized controlled trials (RCTs) have shaped modern scientific practice, there has…
Alejandro Benito-Santos, Florian Windhager, Aida Horaniet Ibañez, Rabea Kleymann + 2 more
The intersection of visualization and the humanities (VIS\H) is marked by a tension between chasing analytical "insight" and interpretive "meaning." The effectiveness of visualization techniques hinges on established evaluation frameworks that assess both analytical utility and communicative efficacy, creating a…
Daniel P. Kidder, Leslie A. Fierro, Elena Luna, Heather Salvaggio + 122 more
'Amanda McWhorter' 'Shelly-Ann Bowen' 'Rebecca Murphy-Hoefer' 'Sally Thigpen' 'Dayna Alexander' 'Theresa L. Armstead' 'Euna August' 'Destiny Bruce' 'Seseni Nu Clarke' 'Cassandra Davis' 'Amia Downes' 'Sarah Gill' 'L. Duane House' 'Michael Kerzner' 'Karen Kun' 'Karen Mumford' 'Leah Robin' 'Dara Schlueter' 'Michael…
Lin Feng, Arran Zeyu Wang, Md Dilshadur Rahman, Danielle Albers Szafir + 1 more
Distribution Across Contribution Types Authors: ['Lin Feng' 'Arran Zeyu Wang' 'Md Dilshadur Rahman' 'Danielle Albers Szafir' 'Ghulam Jilani Quadri'] In the rapidly evolving field of information visualization, rigorous evaluation is essential for validating new techniques, understanding user interactions, and…
Lida Kanari, Stanislav Schmidt, Francesco Casalegno, Emilie Delattre + 7 more
The shape of neuronal morphologies plays a critical role in determining their dynamical properties and the functionality of the brain. With an abundance of neuronal morphology reconstructions, a robust definition of cell types is important to understand their role in brain functionality. However, an objective…
Jianfeng Zhan, Lei Wang, Wanling Gao, Hongxiao Li + 9 more
'Yunyou Huang' 'Yatao Li' 'Zhengxin Yang' 'Guoxin Kang' 'Chunjie Luo' 'Hainan Ye' 'Shaopeng Dai' 'Zhifei Zhang'] Evaluation is a crucial aspect of human existence and plays a vital role in various fields. However, it is often approached in an empirical and ad-hoc manner, lacking consensus on universal concepts…
Danqing Yin, Zhongmin Zhang, Xinci Liu, Ke Ni + 8 more
As single-cell omics transitions into the era of AI-virtual cells (AIVC), where large-scale single-cell data integration becomes prevalent, the computational demands of integration evaluation emerge as critical scalability bottlenecks. Traditional integration evaluation pipelines, requiring metrics like…
Jia Jiayi, Zhao Tianjiao, Yang Junyu, Wang Qian
The evaluation of design results plays a crucial role in the development of design. This study presents a design work evaluation system for design education that assists design instructors in conducting objective evaluations. An automatic design evaluation model based on convolutional neural networks has been…
Authors not listed
The effectiveness of machine learning (ML) in drug discovery hinges on evaluation and modeling approaches that align with how compounds are tested and compared in real experimental contexts. We observe that experimental data in public repositories like ChEMBL naturally clusters by assay origin, while retaining…
Siyuan Luo, Pierre-Luc Germain, Ferdinand von Meyenn, Mark D. Robinson
Benchmarks are crucial to understanding the strengths and weaknesses of the growing number of tools for single-cell and spatial omics analysis. A key task is to distinguish subpopulations within complex tissues, where evaluation typically relies on external clustering validation metrics. Different metrics often lead to…
Bettina Bader, Michaela Coenen, Julia Hummel, Petra Schoenweger + 2 more
'Stephan Voss' 'Caroline Jung-Sievers'] Background In recent decades, community-based interventions have been increasingly adopted in the field of health promotion and prevention. While their evaluation is relevant for health researchers, stakeholders and practitioners, conducting these evaluations is also challenging…
Henan Wu, Xiaorui Sun, Dejun Li, Yan Zhao
The aim of this paper is to propose a scientific and practical evaluation method for college students' learning evaluation. The students' learning experience and harvest are the ultimate embodiment of colleges teaching quality. Considering the multilevel and fuzzy characteristics of learning evaluation, a novel college…
Minkyung Oh, Bo Young Yoon, Sun Huh
Purpose The Dr. LEE Jong-wook Fellowship Program, established by the Korea Foundation for International Healthcare (KOFIH), aims to strengthen healthcare capacity in partner countries. The aim of the study was to develop new performance evaluation indicators for the program to better assess long-term educational impact…
Authors not listed
Bayesian optimization (BO) has become increasingly important for experimental optimization across scientific domains, yet implementing BO pipelines requires significant programming expertise and familiarity with specialized frameworks. This creates a barrier for domain experts who could benefit from BO but lack the…
Daniela Quiñones, Luis Felipe Rojas, Renato Olavarría, Claudio Cubillos + 6 more
Extended Reality (XR) technologies are increasingly used to create immersive and interactive systems across domains such as education, training, health, and entertainment. As these systems become more complex and multisensory, evaluating user experience (UX) in XR environments requires approaches that go beyond…
Nouf Sulaiman Alharbi
Background Few published articles provide a comprehensive overview of the available evidence on the topic of evaluating competency-based medical education (CBME) curricula. The purpose of this review is therefore to synthesize the available evidence on the evaluation practices for competency-based curricula employed in…
Grace Yeeun Lee, Ian Bernard Hickie, Jo-An Occhipinti, Yun Ju Christine Song + 6 more
The papers included for synthesis either described a theoretical evaluation framework and/or criteria with no application to a case study ; described a theoretical evaluation framework and/or criteria applied to a case study , or; described an evaluation process applied to a case study . The majority of the evaluation…
Xiaoqi Cabiria Liang, Nick Robertson, Marni Torkel, Sanghyun Kim + 3 more
The rapid growth of computational methods for the computational biology field highlights the critical role of benchmarking in guiding method selection. However, there is no standardised data structure that effectively links and stores datasets, performance metrics and available ground truth. Without such a unified and…
Maria H. Rasmussen, Chenru Duan, Heather J. Kulik, Jan Halborg Jensen
With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet…
Fuzhan Rahmanian, Robert M. Lee, Dominik Linzner, Kathrin Michel + 4 more
Predicting and monitoring battery life early and across chemistries is a significant challenge due to the plethora of degradation paths, form factors, and electrochemical testing protocols. Existing models typically translate poorly across different electrode, electrolyte, and additive materials, mostly require a fixed…
Yue Cao, Lijia Yu, Marni Torkel, Sanghyun Kim + 5 more
With the rapid development of computational methods for single-cell sequencing data, benchmarking serves a valuation resource. As the number of benchmarking studies surges, it is timely to assess the current state of the field. We conducted a systematic literature search and assessed 245 papers, including all 95…
Jenna Brown, Matthew Harrison, Tecle Rufael, Selina Roman-White + 3 more
To align with climate initiatives, multiple reporting programs are transitioning from generic activity-based emission factors to site-specific measured emissions data to estimate greenhouse gas emissions at oil and gas facilities. This study contemporaneously deployed two top-down (TD) aerial methods across 14…
Authors not listed
This paper presents an empirical comparison of process control algorithms, with particular emphasis on classical Proportional–Integral–Derivative (PID) control, Model Predictive Control (MPC), and neural network-based methods in the context of complex industrial plants. Since industrial sectors frequently demand…
Yanlin Zhang, Jing Zhao
We formalize scientific methodology—the end-to-end process from question formulation to evidence-grounded writing—as a phase-gated research protocol with explicit return paths and persistent constraints, and instantiate it for general-purpose language models as executable protocol specifications. The formalization…
William Daniels, Meng Jia, Dorit Hammerling
We propose a generic, modular framework for emission event detection, localization, and quantification on oil and gas production sites that uses concentration data collected by pointin-space continuous monitoring systems (CMS). The framework uses a gradient-based spike detection algorithm to estimate emission start and…