Unraveling Effects of AI Chatbots on EFL Learners’ Language Skill Development: A Meta-analysis

While empirical investigations of artificial intelligence (AI) chatbots for English-as-a-foreign-language (EFL) learners’ language skill development have been receiving considerable attention, a quantitative analysis of its effectiveness and how the pedagogical effects differ under different conditions is still lacking. To bridge the gaps, drawing on the usefulness theoretical framework and the proposed criteria, this study meta-analyzed 21 eligible studies published during 2008–2023 to gain a comprehensive understanding of the overall effect and moderator analyses of AI chatbots for EFL learning. Results indicated that the overall effect was g = 0.648, 95% CI [0.406, 0.891], suggesting that AI chatbots could be effective to facilitate EFL learners’ language skill development. Furthermore, intervention durations and interface designs were found to be significant moderators. Informed by the results obtained, implications for practice were also discussed.