Sign language, a form of visual communication, utilizes hand and body movements to express meaning, providing a crucial means of communication for people with hearing impairments. This communication gap hinders meaningful interactions, social integration, and access to information for hearing-impaired individuals. Addressing these challenges through technological innovations holds the potential to enhance inclusivity and bridge this linguistic divide. Regional Language (Telugu) aligns more closely with cultural nuances, allowing for richer and more authentic communication as relaying on messages through English sign gestures may lead to misunderstandings. The proposed system aims to facilitate communication with hearing-impaired individuals in Telugu by utilizing various libraries and technologies to establish a robust framework. Google API recognizes the Telugu speech then will be translated into sign language gestures corresponding to the Telugu Gesture dataset using NLP, which will be presented through an avatar animated model created using CC4 and Deep Motion. This interactive approach bridges the communication gap between Telugu-speaking caretakers or hospital staff and hearing-impaired individuals in the region. The incorporation of an avatar and sign language gestures adds a natural and engaging dimension to communication, thereby enhancing the user experience and facilitating more effective interactions.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Inclusive Health Care Journey: Virtual Communication for Hearing-Impaired Patients in Telugu States Using Gestures

  • Shivani Isnagari,
  • Rishika Dargula,
  • Lavudi Indhu,
  • Sai Divya,
  • Bhageshwari Ratkal

摘要

Sign language, a form of visual communication, utilizes hand and body movements to express meaning, providing a crucial means of communication for people with hearing impairments. This communication gap hinders meaningful interactions, social integration, and access to information for hearing-impaired individuals. Addressing these challenges through technological innovations holds the potential to enhance inclusivity and bridge this linguistic divide. Regional Language (Telugu) aligns more closely with cultural nuances, allowing for richer and more authentic communication as relaying on messages through English sign gestures may lead to misunderstandings. The proposed system aims to facilitate communication with hearing-impaired individuals in Telugu by utilizing various libraries and technologies to establish a robust framework. Google API recognizes the Telugu speech then will be translated into sign language gestures corresponding to the Telugu Gesture dataset using NLP, which will be presented through an avatar animated model created using CC4 and Deep Motion. This interactive approach bridges the communication gap between Telugu-speaking caretakers or hospital staff and hearing-impaired individuals in the region. The incorporation of an avatar and sign language gestures adds a natural and engaging dimension to communication, thereby enhancing the user experience and facilitating more effective interactions.