From observation assessment to pedagogical decision-making: Capabilities and biases of LLMs in ECE Situational judgment tests
摘要
This study systematically examines the capabilities and biases of large language models (LLMs) in early childhood education (ECE), focusing on child observation assessment and pedagogical decision-making. Using two validated situational judgment test (SJT) instruments, twelve leading Western and Chinese LLMs were evaluated across multiple developmental and instructional scenarios. Results indicate that LLMs demonstrate high stability and relatively strong performance in child observation assessment, particularly in identifying children’s current developmental levels. However, performance declines in pedagogical decision-making tests that require value-laden judgments and complex trade-offs. While no significant differences were found between Chinese and Western models in overall scores, systematic cross-cultural differences emerged in value prioritization, such as emotional support, safety, and rule enforcement. Moreover, all models exhibited consistent decision-making biases, including limited developmental sensitivity, weak methodological awareness, and a preference for order maintenance. These findings suggest that although LLMs hold potential as supportive tools in ECE, their use requires critical mediation to prevent misalignment with child-centered educational principles.