This article describes an approach for maintaining a high-quality question test database, implemented in a real-world case study. The approach leverages answering history from past tests to identify and address problematic records, thus enhancing the overall quality of the database. Key criteria for selection include the percentage of incorrect answers, the proportion of choices for single distractors, and the time spent on each question. These criteria effectively highlight questions needing revision. The method demonstrated simplicity and efficacy in managing a large dataset from past examinations, ensuring continuous database quality. Almost all records flagged for revision were modified by reviewers, leading to significant improvements in the percentage of correct answers in subsequent tests. This indicates that the primary issue was often the question construction rather than test-taker knowledge. An automated module was developed using PHP and MySQL, integrated with frontend frameworks for enhanced usability. This module assists in identifying problematic questions, with final decisions made by reviewers. The study concludes that this tool is valuable for systematic improvements, maintaining the integrity and reliability of the assessment process.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing Examination Question Quality Through Data-Driven Analysis and Systematic Maintenance

  • Grzegorz Szyjewski

摘要

This article describes an approach for maintaining a high-quality question test database, implemented in a real-world case study. The approach leverages answering history from past tests to identify and address problematic records, thus enhancing the overall quality of the database. Key criteria for selection include the percentage of incorrect answers, the proportion of choices for single distractors, and the time spent on each question. These criteria effectively highlight questions needing revision. The method demonstrated simplicity and efficacy in managing a large dataset from past examinations, ensuring continuous database quality. Almost all records flagged for revision were modified by reviewers, leading to significant improvements in the percentage of correct answers in subsequent tests. This indicates that the primary issue was often the question construction rather than test-taker knowledge. An automated module was developed using PHP and MySQL, integrated with frontend frameworks for enhanced usability. This module assists in identifying problematic questions, with final decisions made by reviewers. The study concludes that this tool is valuable for systematic improvements, maintaining the integrity and reliability of the assessment process.