Designing effective adaptive serious games: multimodal interaction strategies for cognitive training in older adults with evidence from China
摘要
As the global population ages, cognitive decline among the elderly has become increasingly significant, affecting quality of life and social participation. Serious games, which integrate interactivity and gamification, have proven effective as cognitive rehabilitation tools, enhancing cognitive training outcomes. Adaptive serious games, which dynamically adjust task difficulty and interaction methods, offer personalized training experiences that align with user abilities, thus improving training efficacy and user engagement. However, there remains a lack of systematic comparative studies examining the specific effects of various interaction method combinations (such as touch, voice, and gesture) on cognitive load and task performance among elderly users. Grounded in Cognitive Load Theory (CLT), this study experimentally assessed the impact of three interaction combinations - touch + voice, touch + gesture, and touch + voice + gesture - on task completion time, accuracy, cognitive load, and physiological responses. The experiment was conducted in China, officially launched on November 4, 2024, for 4 weeks, involving three sessions per week. The results indicate combining touch, voice, and gesture reduces cognitive load. This study empirically supports using multimodal interaction and adaptive design in serious games. Future research should further investigate personalized interaction strategies, assess the long-term effects, and explore their broader application in the context of global aging.