Purpose <p>The validity of patient-reported outcome measures (PROMs) can be threatened by heterogeneity in how patients with the same underlying health status interpret and respond to questions about their health, a phenomenon known as differential item functioning (DIF). Although tree-based latent variable models, such as the partial credit model based on recursive partitioning (PCTree), are used to test for DIF, their performance has not been comprehensively investigated. We evaluated the statistical properties of PCTree to test for DIF in polytomous-scored PROM items.</p> Methods <p>Computer simulations for a variety of data-analytic conditions were used to evaluate the performance of PCTree with and without Bonferroni adjustments. The performance of this model was assessed using Type I error and statistical power rates. The robustness of PCTree with respect to control of the familywise Type I error rate was evaluated using Bradley’s liberal criterion; error rates within the interval of 2.5–7.5% for α = 5.0% indicate the method is robust.</p> Results <p>Using Bradley’s criterion, PCTree with a Bonferroni correction provided good control of familywise Type I error rate across all simulation conditions. The average statistical power rate of PCTree with Bonferroni correction was at least 80% when <i>N</i> <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11136_2025_4018_Article_IEq1.gif" Format="GIF" Height="15" Rendition="HTML" Resolution="72" Type="Linedraw" Width="19" /> </InlineMediaObject> <EquationSource Format="TEX">\(\ge\)</EquationSource> <EquationSource Format="MATHML"><math> <mo>≥</mo> </math></EquationSource> </InlineEquation> 500. The average statistical power rate of the PCTree decreased as the number of explanatory variables not associated with DIF increased.</p> Conclusions <p>PCTree is promising for evaluating DIF in potentially heterogeneous populations. We provide recommendations about data analytic conditions for using the model.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Tree-based latent variable model for assessing differential item functioning in patient-reported outcome measures: a simulation study

  • Olayinka I. Arimoro,
  • Lisa M. Lix,
  • Scott B. Patten,
  • Rick Sawatzky,
  • Veronique Sebille,
  • Juxin Liu,
  • Samuel Wiebe,
  • Colin B. Josephson,
  • Tolulope T. Sajobi

摘要

Purpose

The validity of patient-reported outcome measures (PROMs) can be threatened by heterogeneity in how patients with the same underlying health status interpret and respond to questions about their health, a phenomenon known as differential item functioning (DIF). Although tree-based latent variable models, such as the partial credit model based on recursive partitioning (PCTree), are used to test for DIF, their performance has not been comprehensively investigated. We evaluated the statistical properties of PCTree to test for DIF in polytomous-scored PROM items.

Methods

Computer simulations for a variety of data-analytic conditions were used to evaluate the performance of PCTree with and without Bonferroni adjustments. The performance of this model was assessed using Type I error and statistical power rates. The robustness of PCTree with respect to control of the familywise Type I error rate was evaluated using Bradley’s liberal criterion; error rates within the interval of 2.5–7.5% for α = 5.0% indicate the method is robust.

Results

Using Bradley’s criterion, PCTree with a Bonferroni correction provided good control of familywise Type I error rate across all simulation conditions. The average statistical power rate of PCTree with Bonferroni correction was at least 80% when N \(\ge\) 500. The average statistical power rate of the PCTree decreased as the number of explanatory variables not associated with DIF increased.

Conclusions

PCTree is promising for evaluating DIF in potentially heterogeneous populations. We provide recommendations about data analytic conditions for using the model.