Skip to main navigation Skip to search Skip to main content

Ensuring Quality in AI-Generated Multiple-Choice Questions for Higher Education with the QUEST Framework

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

Abstract

With the rise of generative AI models, such as large language models (LLMs), in educational settings, there is a growing demand to ensure the quality of AI-generated multiple-choice questions (MCQs) used in higher education. Traditional quiz development methods fall short in addressing the unique challenges posed by AI-generated content, such as consistency, cognitive demand, and question uniqueness. This paper presents the QUEST framework, a structured approach designed specifically to evaluate the quality of LLM-generated MCQs across five dimensions: Quality, Uniqueness, Effort, Structure, and Transparency. Following an iterative research process, AI-generated questions were assessed and refined using QUEST, revealing that the framework effectively improves question clarity, relevance, and educational value. The findings suggest that QUEST is a viable tool for educators to maintain high-quality standards in AI-generated assessments, ensuring these resources meet the pedagogical needs of diverse learners in higher education.
Original languageEnglish
Title of host publicationNew Media Pedagogy
Subtitle of host publicationResearch Trends, Methodological Challenges, and Successful Implementations - 3rd International Conference, NMP 2024, Revised Selected Papers
EditorsLukasz Tomczyk
PublisherSpringer, Cham
Pages293-303
Number of pages11
ISBN (Electronic)978-3-031-95627-0
ISBN (Print)978-3-031-95626-3
DOIs
Publication statusPublished - 29 Jun 2025
Event3rd International Conference, NMP 2024 - Kraków, Poland
Duration: 28 Nov 202429 Nov 2024

Publication series

NameCommunications in Computer and Information Science
Volume2537 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference3rd International Conference, NMP 2024
Country/TerritoryPoland
CityKraków
Period28/11/2429/11/24

Fields of Expertise

  • Information, Communication & Computing

Cite this