Keeping Humans in the Loop: LLM Supported Oral Examinations

This paper investigates the use of generative AI to prepare oral examinations. The aim is to support oral exams regardless of whether the student uses generative AI. Oral exams have long been viewed as inefficient, subjective, or unfair. Generative AI has the potential to mitigate some of these concerns. This paper reports on a prototype developed to prepare vivas for essays in software engineering. This position paper discusses underlying principles, a proposed design and workflow, as well as limitations on both the technology and its use.