Automated recognition of student engagement in online learning is crucial as it enables teachers to adapt content delivery to improve learning. In this paper, we explore a method that finetunes a pretrained vision language model (VLM) to recognize student engagement markers in still images. Our model learns to avoid incorrect answers during finetuning by using the emerging direct preference optimization techniques on self-generated preference pairs based on the correct and incorrect VLM answers. On publicly available student engagement datasets, our model shows superior performance over other approaches and substantially better generalizability over the traditional vision methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Generalizable Detection of Student Engagement in Online Learning Environments

  • Lu Pang,
  • Tony Siu,
  • Anis Alazzawe,
  • Krishna Kant,
  • Longin Jan Latecki

摘要

Automated recognition of student engagement in online learning is crucial as it enables teachers to adapt content delivery to improve learning. In this paper, we explore a method that finetunes a pretrained vision language model (VLM) to recognize student engagement markers in still images. Our model learns to avoid incorrect answers during finetuning by using the emerging direct preference optimization techniques on self-generated preference pairs based on the correct and incorrect VLM answers. On publicly available student engagement datasets, our model shows superior performance over other approaches and substantially better generalizability over the traditional vision methods.