Open-ended questions offer deep insights into students’ reasoning, but present persistent challenges in terms of grading consistency and bias. In this paper, we introduce Criterium, a teacher-assistant system designed to support fair, explainable, and scalable evaluation of open-ended student responses, particularly in the humanities. Unlike traditional automated grading solutions, Criterium places the teacher at the center of the evaluation loop, offering structured rubrics, prompt-based LLM scoring, and optional content retrieval to anchor judgments in curricular material. We present the system architecture, the underlying scoring model – which distinguishes minimum from advanced criteria – and results from a real-world pilot involving multiple classes and assignments. Criterium aims not to replace teacher judgment, but to enhance its objectivity and traceability in both formative and summative contexts.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Criterium: Assisting Teachers in Fair and Consistent Grading of Open-Ended Questions

  • Stefano D’Urso,
  • Filippo Sciarrone

摘要

Open-ended questions offer deep insights into students’ reasoning, but present persistent challenges in terms of grading consistency and bias. In this paper, we introduce Criterium, a teacher-assistant system designed to support fair, explainable, and scalable evaluation of open-ended student responses, particularly in the humanities. Unlike traditional automated grading solutions, Criterium places the teacher at the center of the evaluation loop, offering structured rubrics, prompt-based LLM scoring, and optional content retrieval to anchor judgments in curricular material. We present the system architecture, the underlying scoring model – which distinguishes minimum from advanced criteria – and results from a real-world pilot involving multiple classes and assignments. Criterium aims not to replace teacher judgment, but to enhance its objectivity and traceability in both formative and summative contexts.