Communication barriers pose significant challenges for individuals with speech impairments, hindering meaningful interactions in both personal and professional contexts. While sign language serves as a vital communication tool for the hearing-impaired community, its limited comprehension among non-signers often leads to social isolation and restricted engagement. To tackle this issue, we are introducing a versatile translation device that objectives to bridge the communication hole among listening to impaired individuals and those who don’t know sign language. This innovative platform recognizes and interprets sign language gestures from video input, while also processing text and audio inputs to produce animated video outputs. For video inputs, the system displays real-time interpretations of detected signs in the upper left corner of the camera feed, enhancing understanding and interaction. Designed with user-friendliness and adaptability in mind, the platform accommodates various sign languages and is suitable for diverse environments, including workplaces, educational institutions, healthcare facilities, and social gatherings. Developed in collaboration with the hearing-impaired community, the system is ethically and practically tailored to address their specific needs. This groundbreaking solution not only bridges communication gaps and empowers hearing-impaired individuals but also promotes acceptance and complements existing methods to foster improved understanding between them and the broader community.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multimodal Sign Language Translation System

  • Yerramsetti Yesu Jyothi,
  • Rodda Vijaya Lakshmi,
  • Ravipati Kavya Sri Lakshmi Sowjanya,
  • Parimi Geethanjali,
  • Songa Sowmya Madhuri,
  • Tirumani Nandini

摘要

Communication barriers pose significant challenges for individuals with speech impairments, hindering meaningful interactions in both personal and professional contexts. While sign language serves as a vital communication tool for the hearing-impaired community, its limited comprehension among non-signers often leads to social isolation and restricted engagement. To tackle this issue, we are introducing a versatile translation device that objectives to bridge the communication hole among listening to impaired individuals and those who don’t know sign language. This innovative platform recognizes and interprets sign language gestures from video input, while also processing text and audio inputs to produce animated video outputs. For video inputs, the system displays real-time interpretations of detected signs in the upper left corner of the camera feed, enhancing understanding and interaction. Designed with user-friendliness and adaptability in mind, the platform accommodates various sign languages and is suitable for diverse environments, including workplaces, educational institutions, healthcare facilities, and social gatherings. Developed in collaboration with the hearing-impaired community, the system is ethically and practically tailored to address their specific needs. This groundbreaking solution not only bridges communication gaps and empowers hearing-impaired individuals but also promotes acceptance and complements existing methods to foster improved understanding between them and the broader community.