This chapter provides practical guidelines on standard setting procedures for establishing performance standards in high-stakes assessments. The chapter begins by explaining the key concepts applied in validity frameworks for education measurement, including procedural, internal, external, and consequential criteria in standard setting procedures. The chapter also details the general steps involved before, during, and after the standard setting protocol. Judges’ feedback and evaluation forms are utilized at the end of the standard setting meeting to assess judges’ overall understanding of the standard setting method following training, their opinions of and confidence in applying the method, and their views on the passing score generated in the standard setting process. Post-assessment psychometric analysis provides feedback to judges, thereby allowing them to use the performance data to estimate the passing score and identify deficient items before finalizing the standard. Finally, the chapter summarizes judges’ ratings analysis as part of the documentation and internal validity evidence for the process. The chapter recommends best practices for implementing criterion-referenced standard setting in dental assessments, offering insights into the methodologies and analyses that support valid and fair pass–fail decisions.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Guidelines for Criterion-Referenced Standard Setting Procedure in Dental Assessment

  • Ting Khee Ho,
  • Reza Vahid Roudsari,
  • Noor Lide Abu Kassim

摘要

This chapter provides practical guidelines on standard setting procedures for establishing performance standards in high-stakes assessments. The chapter begins by explaining the key concepts applied in validity frameworks for education measurement, including procedural, internal, external, and consequential criteria in standard setting procedures. The chapter also details the general steps involved before, during, and after the standard setting protocol. Judges’ feedback and evaluation forms are utilized at the end of the standard setting meeting to assess judges’ overall understanding of the standard setting method following training, their opinions of and confidence in applying the method, and their views on the passing score generated in the standard setting process. Post-assessment psychometric analysis provides feedback to judges, thereby allowing them to use the performance data to estimate the passing score and identify deficient items before finalizing the standard. Finally, the chapter summarizes judges’ ratings analysis as part of the documentation and internal validity evidence for the process. The chapter recommends best practices for implementing criterion-referenced standard setting in dental assessments, offering insights into the methodologies and analyses that support valid and fair pass–fail decisions.