Scholarlink

Background <p>Competence in medical training requires trainees to independently demonstrate practical skills. The ICO-OCEX (International Council of Ophthalmology-Ophthalmic Clinical Evaluation Exercise) tool, an improved version of OCEX (Ophthalmic clinical evaluation exercise), employs behaviorally descriptive milestones based on the Dreyfus model to address inconsistent grading interpretations and effectively assess ophthalmology residents’ competencies through workplace-based assessments.</p> Purpose <p>To determine the validity and reliability of ICO-OCEX formative assessment tool for ophthalmology postgraduate residents.</p> Methods <p>A multiphase mixed-method instrument developmental approach was used. Quantitative content validation was conducted using the modified Delphi technique, while cognitive pretesting assessed response process validity. Pilot testing was carried out to evaluate construct validity, as well as reliability and inter-rater reliability.</p> Results <p>The modified Delphi technique achieved consensus on all 33 items, confirming stability and a scale content validity index of 0.97. Cognitive interviews led to revisions, resulting in a 34-item instrument. Confirmatory factor analysis indicated a good to excellent model fit. Cronbach’s alpha was 0.995 and Fleiss Kappa showed moderate to substantial inter-rater reliability.</p> Conclusion <p>The ICO-OCEX tool, consisting of 34 items measuring four constructs on a three-point Dreyfus scale, demonstrated acceptable validity and reliability. It may be useful for formative assessment and supporting competency development in ophthalmology residency programs, particularly when faculty receive training for consistent application.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Validation of the ICO-OCEX tool for competency-based assessment in ophthalmology residency programs

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年4月9日

查看全文
  • Ambreen Gull,
  • Rahila Yasmin,
  • Usman Mahboob,
  • Karl C. Golnik,
  • Muhammad Moin

摘要

Background

Competence in medical training requires trainees to independently demonstrate practical skills. The ICO-OCEX (International Council of Ophthalmology-Ophthalmic Clinical Evaluation Exercise) tool, an improved version of OCEX (Ophthalmic clinical evaluation exercise), employs behaviorally descriptive milestones based on the Dreyfus model to address inconsistent grading interpretations and effectively assess ophthalmology residents’ competencies through workplace-based assessments.

Purpose

To determine the validity and reliability of ICO-OCEX formative assessment tool for ophthalmology postgraduate residents.

Methods

A multiphase mixed-method instrument developmental approach was used. Quantitative content validation was conducted using the modified Delphi technique, while cognitive pretesting assessed response process validity. Pilot testing was carried out to evaluate construct validity, as well as reliability and inter-rater reliability.

Results

The modified Delphi technique achieved consensus on all 33 items, confirming stability and a scale content validity index of 0.97. Cognitive interviews led to revisions, resulting in a 34-item instrument. Confirmatory factor analysis indicated a good to excellent model fit. Cronbach’s alpha was 0.995 and Fleiss Kappa showed moderate to substantial inter-rater reliability.

Conclusion

The ICO-OCEX tool, consisting of 34 items measuring four constructs on a three-point Dreyfus scale, demonstrated acceptable validity and reliability. It may be useful for formative assessment and supporting competency development in ophthalmology residency programs, particularly when faculty receive training for consistent application.