Maximizing learning for all students in digital learning environments could be achieved by using real-time personalized support for Self-Regulated Learning (SRL), a critical skill where learners monitor and guide their learning. To provide such SRL support, the ability to track students’ SRL during learning is key. While SRL has been extensively studied, measuring SRL through the evolving text remains largely unexplored. Yet, such real-time measurement could enable real-time support during writing. Real-time performance tracking transforms personalized support from reactive to proactive, ensuring that students get the help they need exactly when needed, ultimately enhancing students’ learning outcomes and SRL skills. Therefore, this study explores automated SRL detection in evolving essay texts using natural language processing (NLP) methods. Multiple Machine Learning (ML) models were trained and evaluated to assess their effectiveness in classifying SRL processes during writing. Specifically, this research addresses the question: To what extent can different ML models accurately classify different cognitive and metacognitive processes students apply during writing?. Keystroke data was feature-engineered into time-based segments to facilitate real-time application, capturing the evolving essay text. The model’s classifications were compared against manual coding to assess the reliability and accuracy. The model’s results show an average accuracy of 0.78, Cohen’s Kappa of 0.62, and a macro F1-score of 0.45. These results indicate that NLP methods can be used to classify SRL to inform real-time personalized support.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Towards Real-Time Automated Self-regulated Learning Detection in Essays

  • Inti Bistolfi,
  • Susanne de Mooij,
  • Joep van der Graaf,
  • Inge Molenaar

摘要

Maximizing learning for all students in digital learning environments could be achieved by using real-time personalized support for Self-Regulated Learning (SRL), a critical skill where learners monitor and guide their learning. To provide such SRL support, the ability to track students’ SRL during learning is key. While SRL has been extensively studied, measuring SRL through the evolving text remains largely unexplored. Yet, such real-time measurement could enable real-time support during writing. Real-time performance tracking transforms personalized support from reactive to proactive, ensuring that students get the help they need exactly when needed, ultimately enhancing students’ learning outcomes and SRL skills. Therefore, this study explores automated SRL detection in evolving essay texts using natural language processing (NLP) methods. Multiple Machine Learning (ML) models were trained and evaluated to assess their effectiveness in classifying SRL processes during writing. Specifically, this research addresses the question: To what extent can different ML models accurately classify different cognitive and metacognitive processes students apply during writing?. Keystroke data was feature-engineered into time-based segments to facilitate real-time application, capturing the evolving essay text. The model’s classifications were compared against manual coding to assess the reliability and accuracy. The model’s results show an average accuracy of 0.78, Cohen’s Kappa of 0.62, and a macro F1-score of 0.45. These results indicate that NLP methods can be used to classify SRL to inform real-time personalized support.