19 papers · ranked by Valyu relevance
Authors not listed
Specifications grading is an alternative grading system that has been used with increasing frequency in higher education. Since first introduced by Linda Nilson in 2014, more than 91 publications on the design and implementation of specifications grading systems have been published. This work presents a systematic…
Yuki Ito, Qiang Ma
Providing students with detailed and timely grading feedback is essential for self-learning. While existing LLM-based grading systems are promising, most of them rely on one single model, which limits their performance. To address this, we propose Ensemble Tree-of-Thought (ToT), a framework that enhances LLM outputs by…
Uchswas Paul, Ananya Mantravadi, Jash Shah, Shail Shah + 3 more
Uchswas Paul ∗ , Ananya Mantravadi ∗ , Jash Shah ∗ , Shail Shah ∗ , Sri Vaishnavi Mylavarapu ∗ , M Parvez Rashid† , Edward Gehringer ∗ ∗ Department of Computer Science, North Carolina State University, Raleigh, NC, USA Emails: {upaul, amantra, jshah23, sshah38, smylava, efg}@ncsu.edu †Department of Computer Science…
Brian P. Kavanagh
Brian Kavanagh critiques the GRADE system of grading guidelines, arguing that even though it has evolved through the Evidence-Based Medicine movement, there is no evidence that GRADE itself is reliable.
Hedayat Zarkoob, Farzad Abdolhosseini, Kevin Leyton‐Brown
Mechanical TA 2 (MTA2) is an open source web-based peer grading application that leverages trusted TA graders to incentivize high-quality peer review. A previous, prototype implementation of MTA proved the value of the concept, but was neither suitable for use at scale nor easily extensible; MTA2 is a complete…
Holger J Schünemann, Atle Fretheim, Andrew D Oxman
Background The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the ninth of a series of 16 reviews that have been prepared as…
G. Meyer, Pierre Breuer, Jonathan Fürst
Open-ended questions test a more thorough understanding than closed-ended questions and are often a preferred assessment method. However, open-ended questions are tedious to grade and subject to personal bias. Therefore, there have been efforts to speed up the grading process through automation. Short Answer Grading…
Hans Henrik Sievertsen
Assessments such as standardized tests and teacher evaluations of students' classroom participation are central elements of most educational systems. Assessments inform the student, parent, teacher, and school about the student learning progress. Individuals use the information to adjust their study efforts and to make…
Caleb W. Grote, Matthew J. Mackay, Xiangliang Liu, Qinghua Lu + 1 more
This study aimed to develop a comprehensive but easy to apply histologic grading system to score osteoarthritic changes in the whole knee joint for both spontaneous and posttraumatic osteoarthritis (OA) mouse models. The new OA grading scheme was developed based on extensive literature review and the authors’…
Okyaz Eminaga, Fred Saad, Zhe Tian, Ulrich Wolffgang + 11 more
Besides grading, deep learning could improve expert consensus to predict prostate cancer (PCa) recurrence. We developed a novel PCa recurrence prediction system based on artificial intelligence (AI). We validated it using multi-institutional and international datasets comprising 2,647 PCa patients with at least a…
Reza Mehvar, Pierrick Bedouch
The peer-reviewed literature on the adjustment or curving of assessments in health profession programs is almost non-existent. This communication aims to present potential methods of grade adjustment for individual questions or entire assessments. Simulated data for a 25-item assessment were used as an example to…
Giuseppe Mignemi, Yunxiao Chen, Irini Moustaki
Peer grading is an educational system in which students assess each other’s work. It is commonly applied under Massive Open Online Course (MOOC) and offline classroom settings. With this system, instructors receive a reduced grading workload, and students enhance their understanding of course materials by grading…
Lachlan McGinness
Automatically grading the diverse range of question types in high school physics problem is a challenge that requires automated grading techniques from different fields. We report the findings of a Systematic Literature Review of potential physics grading techniques. We propose a multi-modal AI grading framework to…
Andreas Möltner
In the written part of German state exams, multiple choice questions which inherit a flaw are not always excluded but taken into consideration when awarding a grade to any individual candidate, if this is advantageous to the candidate. This process of elimination and compensation of disadvantage in flawed questions, as…
Siew Wan Yeo, Christina Signorelli, Khanh Vo, Greg Smith
OBJECTIVES The use of analytic rubrics in assessing and grading students’ performance has become more prominent among instructors due to its reliability and validity in ensuring consistency in student evaluation. However, there is limited evidence demonstrating the consistency of examiner judgments between analytic…
Chris L. B. Graham, Thomas E. Landrain, Amber Vjestica, Bastian Greshake Tzovoras + 5 more
Resource allocation is essential to the selection and implementation of innovative projects in science and technology. With large stakes involved in concentrating large fundings over a few promising projects, current “winner-take-all” models for grant applications are time-intensive endeavours that mobilise significant…
Anna M. Biller, Carmen Molenda, Fabian Obster, Giulia Zerbini + 3 more
The mismatch between teenagers’ late sleep phase and early school start time results in acute and chronic sleep reductions. This is not only harmful for students’ learning in the short-term but may impact on students’ career prospects and widen social inequalities. Delaying school start times has been shown to improve…
Lex Borghans, Ron Diris, Wendy Smits, Jannes de Vries
This study analyzes the long-run effects of secondary school track assignment for students at the achievement margin. Theoretically, track assignment maximizes individual outcomes when thresholds between tracks are set at the level of the indifferent student, and any other thresholds would imply that students at or…
Szu Szu Ling, Fabrice Saffre, Deborah L. Gater, Lilia Halim + 1 more
Computer quiz games are introduced to improve teaching and learning in a freshman engineering chemistry course in an English-as-a-Second-Language (ESL) environment. These quiz games are developed and implemented as a supplemental and augmentative tool to enhance traditionally delivered lectures. The paper shows an…