4 papers · ranked by Valyu relevance
Germana Bertoli, Ilaria Amelia Caggiano, Francesca Lagioia, Riccardo Rovatti + 2 more
The article reports on a blind Turing Test experiment, assessing the performance of out-of-the-box leading LLMs on three Italian legal professional exams: the Bar, Judges and Notary exams. Leading LLMs were asked to generate full written exam papers, which were made indistinguishable from human submissions and…
Michael James Bommarito, Daniel Katz
Nearly all jurisdictions in the United States require a professional license exam, commonly referred to as "the Bar Exam," as a precondition for law practice. To even sit for the exam, most jurisdictions require that an applicant completes at least seven years of post-secondary education, including three years at an…
Daniel Martin Katz, Michael James Bommarito, Shang Gao, Pablo Arredondo
'Pablo Arredondo'] In this paper, we experimentally evaluate the zero-shot performance of GPT-4 against prior generations of GPT on the entire uniform bar examination (UBE), including not only the multiple-choice multistate bar examination (MBE), but also the open-ended multistate essay exam (MEE) and multistate…
Tsegaye Kindu Nibret
The difficulty index, discrimination and distracter efficiency of college level exam paper was analyzed as an input for taking actions in future test developments. The exam papers of 176 first-year regular pre-service diploma students at Gondar CTE were analyzed using descriptive analysis. Difficulty indices and…