The Effects of a Virtual Instructor with Realistic Lip Sync in an Augmented Reality Environment

In this study, we explore the impact of incorporating a virtual instructor with realistic lip-syncing in an augmented reality (AR) learning environment. The study is particularly focused on understanding if this enhancement can reduce students’ mental workload and improve system usability and performance in AR learning. The research stems from previous feedback indicating that a virtual instructor without facial movements was perceived as “creepy” and “distracting.” The updated virtual instructor includes facial animations, such as blinking and synchronized lip movements, especially during lecture explanations. The study aims to determine if there are significant changes in mental workload and usability differences between the AR systems with and without the enhanced virtual instructor. The study found significant differences in the usability scores in some questions. However, there was no significant difference in the mental workload between them.