Memô the Game: Serious Game for Development of Memorization in Children with Autistic Spectrum Disorder

This work presents the architecture and development of the Serious Game (SG) Memô which is aimed at exercising the Short-Term Memory (STM) of children with Autism Spectrum Disorder (ASD). This serious game proposes an individualized functional approach through Dynamic Difficulty Adjustment (DDA), which considers the performance, the expressed facial emotions, and the level of eye attention during child performance. In addition, it is used to recording the presence of hand and eye stereotypies. The SG is developed in Unity 3D, uses MediaPipe to determine the points of the hands, and is executed by our Socially Assistive Robot (SAR), termed Mobile Autonomous Robot for Interaction with Autistics and Trisomy 21 (MARIA T21). We believe that the creation of SGs to assist in the cognitive development of children with ASD and explore the detection of other stereotyped movements, associating them with a communicative and emotional proposal, is feasible.