<p><i>g</i><sub>AB</sub> is a design-comparable effect size that has been recommended by the What Works Clearinghouse since 2020 to assess an intervention effect in single-case studies and for meta-analyses. Yet, no research has systematically studied how <i>g</i><sub>AB</sub>’s performance could be impacted by its non-convergence, and how <i>g</i><sub>AB</sub>’s non-convergence and performance could be improved by increasing the case size (<i>m</i>) and measurement size (<i>N</i>). This study expanded on the work of Pustejovsky et al. (<i>Journal of Educational and Behavioral Statistics, 39</i>(5), 368–393,&#xa0;<CitationRef CitationID="CR62">2014</CitationRef>) and Chen et al. (<i>Behavioral Research Methods, 56</i>, 379–405,&#xa0;<CitationRef CitationID="CR17">2024</CitationRef>) to investigate the impact of a wide range of <i>m</i> and <i>N</i>, data distribution, autocorrelation, within-case reliability, and ratio of variance components on <i>g</i><sub>AB</sub>’s non-convergence rate and performance in multiple-baseline designs. <i>g</i><sub>AB</sub>’s performance was assessed by relative bias, relative bias of variance, and coverage rate of 95% symmetric CIs. Findings revealed that <i>g</i><sub>AB</sub>’s performance was improved by convergence, especially when data were non-normal. In addition, <i>g</i><sub>AB</sub>’s convergence improved by increasing <i>m</i>, within-case reliability, and ratio of variance components. When data distribution was normal, converged <i>g</i><sub>AB</sub> improved with large <i>m</i> and large within-case reliability. When data distribution was mildly non-normal, converged <i>g</i><sub>AB</sub> improved with medium to large <i>m</i> and small within-case reliability. When data distribution was moderately non-normal, converged <i>g</i><sub>AB</sub> improved with small to medium <i>m</i> and small within-case reliability. Optimal <i>m</i> depended on data distribution and within-case reliability. <i>N</i> had a trivial impact on converged <i>g</i><sub>AB</sub>. In sum, our findings demonstrated the importance of <i>g</i><sub>AB</sub>’s convergence and optimal <i>m</i> to improve its application.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Improving applications of a design-comparable effect size in single-case designs

  • Yi-Kai Chen,
  • Tong-Rong Yang,
  • Li-Ting Chen,
  • Cheng-Yu Hsieh,
  • Che Cheng,
  • Po-Ju Wu,
  • Chao-Ying Joanne Peng

摘要

gAB is a design-comparable effect size that has been recommended by the What Works Clearinghouse since 2020 to assess an intervention effect in single-case studies and for meta-analyses. Yet, no research has systematically studied how gAB’s performance could be impacted by its non-convergence, and how gAB’s non-convergence and performance could be improved by increasing the case size (m) and measurement size (N). This study expanded on the work of Pustejovsky et al. (Journal of Educational and Behavioral Statistics, 39(5), 368–393, 2014) and Chen et al. (Behavioral Research Methods, 56, 379–405, 2024) to investigate the impact of a wide range of m and N, data distribution, autocorrelation, within-case reliability, and ratio of variance components on gAB’s non-convergence rate and performance in multiple-baseline designs. gAB’s performance was assessed by relative bias, relative bias of variance, and coverage rate of 95% symmetric CIs. Findings revealed that gAB’s performance was improved by convergence, especially when data were non-normal. In addition, gAB’s convergence improved by increasing m, within-case reliability, and ratio of variance components. When data distribution was normal, converged gAB improved with large m and large within-case reliability. When data distribution was mildly non-normal, converged gAB improved with medium to large m and small within-case reliability. When data distribution was moderately non-normal, converged gAB improved with small to medium m and small within-case reliability. Optimal m depended on data distribution and within-case reliability. N had a trivial impact on converged gAB. In sum, our findings demonstrated the importance of gAB’s convergence and optimal m to improve its application.