Scholarlink

<p>Assessing person-fit in cognitive diagnostic assessments is a critical research area. Inability to identify misfitting responses can lead to misinterpretation of students’ attribute profiles, potentially resulting in incorrect remedial actions. Despite its importance, there is a lack of research on person-fit statistics for polytomous cognitive diagnostic models (CDM). To address this, we propose a new person-fit statistic, <i>WR</i>, specifically designed for polytomous items in CDMs. We evaluated <i>WR</i>’s ability to detect three types of abnormal behaviors through simulation studies, comparing its performance with established statistics including <i>l</i><sub><i>z</i></sub>, <i>infit</i>, and <i>outfit</i>. The results show that <i>WR</i> consistently demonstrated stable and superior detection capabilities across all experimental scenarios. Traditional methods showed inconsistent detection abilities for different anomalies; <i>l</i><sub><i>z</i></sub> was more effective at detecting cheating, while <i>infit</i> was better for creative responses. In high-quality test environments, <i>WR</i> performed best, though the difference compared to traditional methods was not significant. However, in low-quality conditions, <i>WR</i> significantly outperformed traditional methods. Overall, <i>WR</i> proved to be an effective tool for detecting person misfit in polytomous scoring CDMs. Finally, we analyzed a real educational assessment data to assess the practical application of <i>WR</i>.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A new person-fit statistic for the detection of aberrant responses in polytomous cognitive diagnostic models

  • 期刊论文

  • 发表日期：

    2025年4月9日

查看全文
  • Xuliang Gao,
  • Minmin Hou,
  • Fang Wang,
  • Jinyu Zhou

摘要

Assessing person-fit in cognitive diagnostic assessments is a critical research area. Inability to identify misfitting responses can lead to misinterpretation of students’ attribute profiles, potentially resulting in incorrect remedial actions. Despite its importance, there is a lack of research on person-fit statistics for polytomous cognitive diagnostic models (CDM). To address this, we propose a new person-fit statistic, WR, specifically designed for polytomous items in CDMs. We evaluated WR’s ability to detect three types of abnormal behaviors through simulation studies, comparing its performance with established statistics including lz, infit, and outfit. The results show that WR consistently demonstrated stable and superior detection capabilities across all experimental scenarios. Traditional methods showed inconsistent detection abilities for different anomalies; lz was more effective at detecting cheating, while infit was better for creative responses. In high-quality test environments, WR performed best, though the difference compared to traditional methods was not significant. However, in low-quality conditions, WR significantly outperformed traditional methods. Overall, WR proved to be an effective tool for detecting person misfit in polytomous scoring CDMs. Finally, we analyzed a real educational assessment data to assess the practical application of WR.