Evaluating ChatGPT accuracy in answering a basketball common content knowledge test in physical education
摘要
ChatGPT has undergone extensive training, and several studies across various disciplines have examined its performance in generating accurate and reliable responses, reporting promising results. However, its effectiveness at delivering accurate answers in the domain of physical education (PE) remains unexplored. The current study sought to fill this gap by (a) assessing ChatGPT accuracy in answering a previously validated basketball Common Content Knowledge (CCK) test and (b) comparing the performance of five ChatGPT versions—4o, 4.5, o3, o4-mini, and o4-mini-high on that test. A comparative cross-sectional design was employed. First, each ChatGPT version was prompted to answer the basketball CCK test. The accuracy of their responses was then compared across versions using Cochran’s Q test. All five ChatGPT versions achieved high CCK scores ranging from 80.6% to 94.4%, with no statistically significant differences among them (p > .107). The results suggest that ChatGPT can answer basketball CCK questions with a high degree of accuracy and that its performance does not differ significantly across the tested versions. The ChatGPT versions assessed in this study may serve as a reliable supplementary resource for PE teachers seeking to generate or verify basketball CCK, such as checking rules, confirming safety guidelines, or producing technique and tactic explanations, with the understanding that such tools do not substitute for professional teacher judgment.