An Integrated Speech to Indian Sign Language Conversion System Using 3D Avatars in Unity
摘要
Effective communication is crucial for meaningful human interactions. Unfortunately, children with speech or hearing impairments face difficulties in expressing themselves. Deaf or mute children rely on Indian Sign Language (ISL), but many people struggle to understand its gestures. This creates a significant communication gap between those with hearing and speech impairments and those unfamiliar with ISL. Our goal is to build an application which provides an interactive interface that can bridge the communication gap between normal and hearing-speaking impaired children. The system takes command using speech recognition and generates an avatar which teaches rhymes through gestures along with audio and text in unity. By combining advanced technology with empathy for the challenges faced by those with hearing and speech impairments, we aim to revolutionize communication and create a more inclusive society.