Large language models (LLMs) have the potential to support teachers by addressing challenges related to time constraints and data literacy, helping them engage more effectively with student learning analytics. While intelligent tutoring systems (ITS) provide valuable data, many teachers find it challenging to extract important insights for instructional decision-making. This study explores how LLM-generated summaries based on assignment reports can provide concise, actionable insights that improve teachers’ ability to understand reports and respond to student performance. Using a randomized design, we aim to evaluate teachers’ perceived usefulness of summaries, their effect on engagement with reports, and the impact on student participation and outcomes.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Evaluating the Impact of LLM-Generated Assignment Report Summaries in Intelligent Tutoring Systems

  • Wen-Chiang Ivan Lim,
  • Neil T. Heffernan

摘要

Large language models (LLMs) have the potential to support teachers by addressing challenges related to time constraints and data literacy, helping them engage more effectively with student learning analytics. While intelligent tutoring systems (ITS) provide valuable data, many teachers find it challenging to extract important insights for instructional decision-making. This study explores how LLM-generated summaries based on assignment reports can provide concise, actionable insights that improve teachers’ ability to understand reports and respond to student performance. Using a randomized design, we aim to evaluate teachers’ perceived usefulness of summaries, their effect on engagement with reports, and the impact on student participation and outcomes.