Guidelines for Criterion-Referenced Standard Setting Procedure in Dental Assessment
摘要
This chapter provides practical guidelines on standard setting procedures for establishing performance standards in high-stakes assessments. The chapter begins by explaining the key concepts applied in validity frameworks for education measurement, including procedural, internal, external, and consequential criteria in standard setting procedures. The chapter also details the general steps involved before, during, and after the standard setting protocol. Judges’ feedback and evaluation forms are utilized at the end of the standard setting meeting to assess judges’ overall understanding of the standard setting method following training, their opinions of and confidence in applying the method, and their views on the passing score generated in the standard setting process. Post-assessment psychometric analysis provides feedback to judges, thereby allowing them to use the performance data to estimate the passing score and identify deficient items before finalizing the standard. Finally, the chapter summarizes judges’ ratings analysis as part of the documentation and internal validity evidence for the process. The chapter recommends best practices for implementing criterion-referenced standard setting in dental assessments, offering insights into the methodologies and analyses that support valid and fair pass–fail decisions.