Human-Object Interaction (HOI) recognition is crucial for understanding the dynamics within educational environments, particularly in student sessions. Current HOI methods predominantly utilize transformer-based architectures due to their capability of capturing contextual interactions effectively. However, existing approaches face significant challenges, including insufficient fine-grained contextual information and limited applicability in specialized domains such as educational settings. This study introduces an innovative deep learning framework integrating HOI detection with advanced Machine Learning Operations (MLOps) and DataOps practices tailored explicitly for analyzing student interactions within educational sessions. We address the critical gap in available datasets by creating a new dataset capturing diverse interaction scenarios typically observed in educational sessions. Our dataset design includes detailed criteria for data selection and annotation, ensuring robust and high-quality interaction representations. Empirical evaluations demonstrate that our proposed integrated HOI-MLOps framework not only achieves superior interaction recognition accuracy compared to traditional models but also significantly enhances scalability and efficiency through streamlined data operations. This study’s contributions provide practical insights into leveraging HOI recognition in educational analytics, ultimately aiding in more effective monitoring and evaluation of student activities in educational environments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Deep Learning-Based Human-Object Interaction Recognition in Student Sessions

  • Pham Ba Tuan Chung,
  • Le Trong Minh,
  • Le Minh Tuan,
  • Phung The Huan,
  • Le Hoang Son

摘要

Human-Object Interaction (HOI) recognition is crucial for understanding the dynamics within educational environments, particularly in student sessions. Current HOI methods predominantly utilize transformer-based architectures due to their capability of capturing contextual interactions effectively. However, existing approaches face significant challenges, including insufficient fine-grained contextual information and limited applicability in specialized domains such as educational settings. This study introduces an innovative deep learning framework integrating HOI detection with advanced Machine Learning Operations (MLOps) and DataOps practices tailored explicitly for analyzing student interactions within educational sessions. We address the critical gap in available datasets by creating a new dataset capturing diverse interaction scenarios typically observed in educational sessions. Our dataset design includes detailed criteria for data selection and annotation, ensuring robust and high-quality interaction representations. Empirical evaluations demonstrate that our proposed integrated HOI-MLOps framework not only achieves superior interaction recognition accuracy compared to traditional models but also significantly enhances scalability and efficiency through streamlined data operations. This study’s contributions provide practical insights into leveraging HOI recognition in educational analytics, ultimately aiding in more effective monitoring and evaluation of student activities in educational environments.