This study presents a rubric for manual labeling of spatial reasoning skills in Shadowspect, a geometric puzzle-solving game that provides a rich dataset for analysis. The rubric facilitates dataset labeling, enabling the exploration of Machine Learning (ML) techniques to assess spatial reasoning through Shadowspect. To validate the rubric, following its guidelines, a dataset of Shadowspect gameplay was annotated and used to train various ML models. The Support Vector Machine regressor (SVR) performed best, achieving an \(R^2\) value of 0.83 and a Mean Square Error (MSE) of 0.06. The predictions of the model closely matched the true values, evidencing the accuracy of the rubric and demonstrating the potential of ML techniques for dynamic, Game-Based Assessment (GBA) of spatial reasoning skills.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Towards the Development of an Assessment Model of Spatial Reasoning with a Serious Game

  • Ana M. Aguilar,
  • Manuel J. Gomez,
  • José A. Ruipérez-Valiente

摘要

This study presents a rubric for manual labeling of spatial reasoning skills in Shadowspect, a geometric puzzle-solving game that provides a rich dataset for analysis. The rubric facilitates dataset labeling, enabling the exploration of Machine Learning (ML) techniques to assess spatial reasoning through Shadowspect. To validate the rubric, following its guidelines, a dataset of Shadowspect gameplay was annotated and used to train various ML models. The Support Vector Machine regressor (SVR) performed best, achieving an \(R^2\) value of 0.83 and a Mean Square Error (MSE) of 0.06. The predictions of the model closely matched the true values, evidencing the accuracy of the rubric and demonstrating the potential of ML techniques for dynamic, Game-Based Assessment (GBA) of spatial reasoning skills.