Empowering Individuals with Speech Disabilities Through an Augmentative and Alternative Communication (AAC) App with Visual Scene Display (VSD)
摘要
Individuals with Complex Communication Needs (CCN) face difficulties in their daily life that call for creative and accessible solutions to overcome these challenges. This paper presents an Android-based Augmentative and Alternative Communication (AAC) application that uses a Visual Scene Display (VSD) interface to empower individuals with CCNs. By using personally relevant photos as communication contexts, the app allows caregivers and AAC users to create picture boards with interactive areas around elements in these photos referred to as ‘hotspots’ that trigger text-to-speech or voice recordings. A novel feature is the integration of Object Detection technology, which automates hotspot creation, thereby reducing the programming burden on caregivers and promoting user independence. Developed through a co-creation process with Speech Language Pathologists (SLPs), the app emphasizes user-centric design, accessibility, and ease of use, especially on the underserved Android platform. Initial usability evaluations suggest that the system not only enhances communication effectiveness but also streamlines the process of scene creation, marking a significant step forward in assistive communication technology.