Asymptotically Correct Person Fit z-Statistics For the Rasch Testlet Model

A well-known person fit statistic in the item response theory (IRT) literature is the \(l_{z}\) $l_z$ statistic (Drasgow et al. in Br J Math Stat Psychol 38(1):67-86, 1985). Snijders (Psychometrika 66(3):331-342, 2001) derived \(l_{z}^{*}\) $l_z^{\ast }$ , which is the asymptotically correct version of \(l_{z}\) $l_z$ when the ability parameter is estimated. However, both statistics and other extensions later developed concern either only the unidimensional IRT models or multidimensional models that require a joint estimate of latent traits across all the dimensions. Considering a marginalized maximum likelihood ability estimator, this paper proposes \(l_{zt}\) $l_{\mathit{zt}}$ and \(l_{zt}^{*}\) $l_{\mathit{zt}}^{\ast }$ , which are extensions of \(l_{z}\) $l_z$ and \(l_{z}^{*}\) $l_z^{\ast }$ , respectively, for the Rasch testlet model. The computation of \(l_{zt}^{*}\) $l_{\mathit{zt}}^{\ast }$ relies on several extensions of the Lord-Wingersky algorithm (1984) that are additional contributions of this paper. Simulation results show that \(l_{zt}^{*}\) $l_{\mathit{zt}}^{\ast }$ has close-to-nominal Type I error rates and satisfactory power for detecting aberrant responses. For unidimensional models, \(l_{zt}\) $l_{\mathit{zt}}$ and \(l_{zt}^{*}\) $l_{\mathit{zt}}^{\ast }$ reduce to \(l_{z}\) $l_z$ and \(l_{z}^{*}\) $l_z^{\ast }$ , respectively, and therefore allows for the evaluation of person fit with a wider range of IRT models. A real data application is presented to show the utility of the proposed statistics for a test with an underlying structure that consists of both the traditional unidimensional component and the Rasch testlet component.