Effective communication is crucial for meaningful human interactions. Unfortunately, children with speech or hearing impairments face difficulties in expressing themselves. Deaf or mute children rely on Indian Sign Language (ISL), but many people struggle to understand its gestures. This creates a significant communication gap between those with hearing and speech impairments and those unfamiliar with ISL. Our goal is to build an application which provides an interactive interface that can bridge the communication gap between normal and hearing-speaking impaired children. The system takes command using speech recognition and generates an avatar which teaches rhymes through gestures along with audio and text in unity. By combining advanced technology with empathy for the challenges faced by those with hearing and speech impairments, we aim to revolutionize communication and create a more inclusive society.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An Integrated Speech to Indian Sign Language Conversion System Using 3D Avatars in Unity

  • A. Sharada,
  • Dega Sunnihitha,
  • Gajula Veera Nandika,
  • Boddu Varshini,
  • Pochu Sushmitha

摘要

Effective communication is crucial for meaningful human interactions. Unfortunately, children with speech or hearing impairments face difficulties in expressing themselves. Deaf or mute children rely on Indian Sign Language (ISL), but many people struggle to understand its gestures. This creates a significant communication gap between those with hearing and speech impairments and those unfamiliar with ISL. Our goal is to build an application which provides an interactive interface that can bridge the communication gap between normal and hearing-speaking impaired children. The system takes command using speech recognition and generates an avatar which teaches rhymes through gestures along with audio and text in unity. By combining advanced technology with empathy for the challenges faced by those with hearing and speech impairments, we aim to revolutionize communication and create a more inclusive society.