<p>With the continuous development of digital learning environments, the demand for providing transparency and explanations about learner profiles (<i>LP</i>s) in the digital era is constantly increasing. Digital learning traces play a fundamental role in understanding <i>LP</i> categories and justifying the reasoning behind their behavior, such as learners <i>in difficulty</i>, <i>active/inactive</i> learners, <i>those in progress</i>, and <i>success-oriented vs. at-risk learners</i>. However, effectively identifying <i>LP</i>s from the massive data generated by these environments is challenging due to its vulnerability to misunderstandings and biases. Moreover, stakeholder may not know what queries to ask or what patterns to look for in the data, while traditional Learning Analytics tools struggle to bridge the gap between granular digital traces and human-interpretable conceptual insights. To address this gap, we propose XAI-Profile, a framework that leverages Explainable AI (XAI) to transform raw learner data into interpretable, actionable profiles. XAI-Profile combines explainable machine learning models with interactive visual workflows to bridge between low-level data traces and high-level pedagogical insights. The framework is built on three pillars: <b>(1)</b> <i>Goal-Oriented Requirements</i> for capturing stakeholders’ needs by refining a problem into sub-problems using goal-oriented AND/OR refinement, and mapping them to the target <i>LP</i> with their data indicators. <b>(2)</b> <i>Visual Analytics Design</i> for mapping <i>LP</i> categories by automatically correlating them with trust objects (e.g., rule-based models, frequent sequences in the data), visualization goals, and analysis types. <b>(3)</b> <i>Interaction and Actionability</i>, a guided process enabling stakeholders to discover interesting and unexpected patterns, validate hypotheses, and drill into context-specific explanations. A case study using data from the <Emphasis FontCategory="NonProportional">écri+</Emphasis> project demonstrates how stakeholders can quickly identify high-level behavioral patterns and drill down into specific profiles of interest. The results highlight how XAI-Profile advances learning analytics practices by making AI-driven insights both trustworthy and actionable fostering a human-centered approach to learner analytics.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Automating transparent learner profiling through explainable AI

  • Abdelkader Ouared,
  • Madeth May,
  • Claudine Piau-Toffolon,
  • Nicolas Dugué

摘要

With the continuous development of digital learning environments, the demand for providing transparency and explanations about learner profiles (LPs) in the digital era is constantly increasing. Digital learning traces play a fundamental role in understanding LP categories and justifying the reasoning behind their behavior, such as learners in difficulty, active/inactive learners, those in progress, and success-oriented vs. at-risk learners. However, effectively identifying LPs from the massive data generated by these environments is challenging due to its vulnerability to misunderstandings and biases. Moreover, stakeholder may not know what queries to ask or what patterns to look for in the data, while traditional Learning Analytics tools struggle to bridge the gap between granular digital traces and human-interpretable conceptual insights. To address this gap, we propose XAI-Profile, a framework that leverages Explainable AI (XAI) to transform raw learner data into interpretable, actionable profiles. XAI-Profile combines explainable machine learning models with interactive visual workflows to bridge between low-level data traces and high-level pedagogical insights. The framework is built on three pillars: (1) Goal-Oriented Requirements for capturing stakeholders’ needs by refining a problem into sub-problems using goal-oriented AND/OR refinement, and mapping them to the target LP with their data indicators. (2) Visual Analytics Design for mapping LP categories by automatically correlating them with trust objects (e.g., rule-based models, frequent sequences in the data), visualization goals, and analysis types. (3) Interaction and Actionability, a guided process enabling stakeholders to discover interesting and unexpected patterns, validate hypotheses, and drill into context-specific explanations. A case study using data from the écri+ project demonstrates how stakeholders can quickly identify high-level behavioral patterns and drill down into specific profiles of interest. The results highlight how XAI-Profile advances learning analytics practices by making AI-driven insights both trustworthy and actionable fostering a human-centered approach to learner analytics.