17 papers · ranked by Valyu relevance
Azam Rabiee, Alok Goel, Johnson D'Souza, Saurabh Khanwalkar
Online learning platforms provide learning materials and answers to students' academic questions by experts, peers, or systems. This paper explores question-type identification as a step in content understanding for an online learning platform. The aim of the question-type identifier is to categorize question types…
Saku Sugawara, Nikita Nangia, Alex Warstadt, Samuel R. Bowman
For a natural language understanding benchmark to be useful in research, it has to consist of examples that are diverse and difficult enough to discriminate among current and near-future state-of-the-art systems. However, we do not yet know how best to select text sources to collect a variety of challenging examples.…
Khiem Vinh Tran, Hao Phu Phan, Khang Nguyen Duc Quach, Ngan Luu-Thuy Nguyen + 2 more
'Ngan Luu-Thuy Nguyen' 'Jun Jo' 'Thành Tâm Nguyên'] Abstract. Question answering over knowledge bases (KBQA) has become a popular approach to help users extract information from knowledge bases. Although several systems exist, choosing one suitable for a particular application scenario is difficult. In this article, we…
Zhou He, Pengcheng Zhao, Fuwei Zhang, Shujin Lin
In the domain of video question answering (VideoQA), the impact of question types on VQA systems, despite its critical importance, has been relatively under-explored to date. However, the richness of question types directly determines the range of concepts a model needs to learn, thereby affecting the upper limit of…
Akira R. Kinjo, Yasunori Yamamoto, Samuel Bustamante-Larriet, Jose-Emilio Labra-Gayo + 1 more
Querying the RDF Portal knowledge graph maintained by DBCLS—which aggregates approximately 60 life-science databases—requires proficiency in both SPARQL and database-specific RDF schemas, placing this resource beyond the reach of most researchers. Large Language Models (LLMs) can, in principle, translate…
Xiaohui Dong, Xinyu Zhang, Zhengluo Li, Quanxin Hou + 3 more
As a key natural language processing (NLP) task, question generation (QG) is crucial for boosting educational quality and fostering personalized learning. This article offers an in-depth review of the research advancements and future directions in QG in education (QGEd). We start by tracing the evolution of QG and…
Christopher Rodriguez, Daniel M. Oppenheimer
The standard approach for detecting and preventing bots from doing harm online involves CAPTCHAs. However, recent AI research, including our own in this manuscript, suggests that bots can complete many common CAPTCHAs with ease. The most effective methodology for identifying potential bots involves completing…
Vinay Setty
Semantic answer type prediction (SMART) is known to be a useful step towards designing effective question answering (QA) systems. The SMART task involves predicting the top- knowledge graph (KG) types for a given natural language question. This is challenging due to the large number of types in KGs. In this paper, we…
Jovana Dobreva, Ivana Karasmanakis, Filip Ivanisevic, Tadej Horvat + 4 more
The paper introduces RAGCare-QA, an extensive dataset of 420 theoretical medical knowledge questions for assessing Retrieval-Augmented Generation (RAG) pipelines in medical education and evaluation settings. The dataset includes one-choice-only questions from six medical specialties (Cardiology, Endocrinology…
Mikhail Salnikov, Maria Lysyuk, Pavel Braslavski, Anton Razzhigaev + 2 more
'Valentin Malykh' 'Alexander Panchenko'] Pre-trained Text-to-Text Language Models (LMs), such as T5 or BART yield promising results in the Knowledge Graph Question Answering (KGQA) task. However, the capacity of the models is limited and the quality decreases for questions with less popular entities. In this paper, we…
Alexander Muacevic, John R Adler, Sofia Lopiano, Evan S Cohen + 2 more
Purpose Current research has shown that Generative AI language models (e.g., ChatGPT) can answer and provide explanations for practice questions and generate new questions. Further investigation is needed to assess how ChatGPT-generated questions compare with National Board of Medical Examiners (NBME)-style questions…
Gunther Eysenbach, Baki Kocaballi, Emre Sezgin, Ashraful Islam + 4 more
Background Noncommunicable diseases (NCDs) constitute a burden on public health. These are best controlled through self-management practices, such as self-information. Fostering patients’ access to health-related information through efficient and accessible channels, such as commercial voice assistants (VAs), may…
Yichun Feng, Lu Zhou, Yikai Zheng, Ruikun He + 2 more
In recent years, Large Language Models (LLMs) have shown promise in various domains, notably in biomedical sciences. However, their real-world application is often limited by issues like erroneous outputs and hallucinatory responses. We developed the Knowledge Graph-based Thought (KGT) framework, an innovative solution…
George Adrian Muntean, Anca Marginean, Adrian Groza, Ioana Damian + 7 more
'Sara Alexia Roman' 'Mădălina Claudia Hapca' 'Anca Mădălina Sere' 'Roxana Mihaela Mănoiu' 'Maximilian Vlad Muntean' 'Simona Delia Nicoară' 'Jae-Ho Han'] Patient compliance in chronic illnesses is essential for disease management. This also applies to age-related macular degeneration (AMD), a chronic acquired retinal…
Dezheng Han, Yibin Jia, Ruxiao Chen, Wenjie Han + 2 more
To enable precise and fully automated cell type annotation with large language models (LLMs), we developed a graph-structured feature–marker database to retrieve entities linked to differential genes for cell reconstruction. We further designed a multi-task workflow to optimize the annotation process. Compared to…
Dao Xuan-Quy, Le Ngoc-Bich, Vo The-Duy, Ngo Bac-Bien + 1 more
This study evaluates the potential and challenges of large langue models (LLMs) for education in chemistry. Specifically, we analyze the performance of two state -of-the art of LLMs, ChatGPT and Microsoft Bing AI Chat, on a quiz dataset consisting of 200 multiple-choice questions in chemistry at the high school level.…
Authors not listed
The Socratic method, grounded in iterative questioning and critical dialogue, offers a compelling framework for leveraging large language models (LLMs) to advance scientific reasoning and discovery in chemistry and materials science. In this paper, we explore how Socratic principles can be integrated into prompt…