This paper presents a Multimodal Emotion-Based Attendance Monitoring System that evaluates both physical presence and cognitive engagement using facial recognition, speech analysis, and posture detection. Unlike traditional methods focused solely on presence, our system records attendance only when engagement exceeds a defined threshold. Facial expressions, vocal sentiment, and posture cues are processed in real-time to determine student attentiveness. A pilot study with 15 students demonstrated a 92% accuracy rate—outperforming traditional methods 78% highlighting the advantages of multimodal fusion. The system shows promise for improving engagement insights and enabling timely, data-driven educational interventions. Future work aims at real-time deployment and enhanced engagement scoring.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multimodal Emotion-Based Attendance and Engagement Monitoring System

  • Gunendra M. Chaturvedi,
  • Kajal Gera,
  • Katyayni Dhiren,
  • Gopal Singh,
  • Akhilesh Verma

摘要

This paper presents a Multimodal Emotion-Based Attendance Monitoring System that evaluates both physical presence and cognitive engagement using facial recognition, speech analysis, and posture detection. Unlike traditional methods focused solely on presence, our system records attendance only when engagement exceeds a defined threshold. Facial expressions, vocal sentiment, and posture cues are processed in real-time to determine student attentiveness. A pilot study with 15 students demonstrated a 92% accuracy rate—outperforming traditional methods 78% highlighting the advantages of multimodal fusion. The system shows promise for improving engagement insights and enabling timely, data-driven educational interventions. Future work aims at real-time deployment and enhanced engagement scoring.