Distractor Analytics on Multiple-Choice Questions using Large Language Models
摘要
Multiple-choice questions (MCQs) are widely used in educational settings due to their automated rating capabilities, ease of administration, and reliability in evaluation. A crucial element of multiple-choice questions (MCQs) is distractors—incorrect answer choices that are designed to assess students’ conceptual understanding by seeming plausible while remaining incorrect. Advanced AI models, including BERT, ChatGPT, Llama, and Gemini AI, offer innovative approaches to generating and evaluating distractors. This study compares the effectiveness of distractor scores generated by advanced AI models, including BERT, ChatGPT, Llama, and Gemini AI, in multiple-choice questions. These AI-driven methods offer diverse approaches to improving the quality and sophistication of distractors, contributing to more robust and dynamic educational assessments. Distractors’ scores can provide educators with a valuable framework to quickly validate solutions, offering insight by analyzing the quantitative differences between distractors.