Dishari: A Novel Gesture-Based Educational Application for Specially Challenged People
摘要
This research explores the integration of advanced technologies, particularly hand gesture detection, and Generative AI, to create an inclusive educational tool called “Dishari" tailored for individuals with hearing and speech impairments. Traditional search engines often fail to address the specific needs of this speech and visually-impaired demographics, leading to a gap in accessibility and inclusivity. Leveraging machine learning algorithms and computer vision technologies, Dishari interprets hand gestures captured via web cameras, translating them into sign language expressions and helping the users search for a particular keyword through the search engine. Furthermore, the incorporation of Generative AI enhances the search functionality, enabling users to input queries through both text and hand gestures. Through a comprehensive literature survey, we highlight the advancements in hand gesture recognition systems and the transformative potential of Generative AI in image and text-based search. Dishari marks a significant milestone in bridging the communication gap and fostering inclusivity by empowering individuals with hearing and speech impairments to navigate the digital landscape effectively.