Indian Sign Language Gesture Recognition Using Bi-Directional LSTM and GRU with Text to Speech Conversion
摘要
This abstract introduces an innovative software system dedicated to recognizing Indian Sign Language (ISL) gestures, leveraging advanced Recurrent Neural Networks (RNNs). ISL plays a pivotal role as a primary communication medium for the deaf and hard-of-hearing community in India. Addressing the critical need for accurate and efficient ISL gesture recognition, our software stands as a pioneering solution, fostering enhanced accessibility and inclusivity. The software meticulously captures the intricate nuances of ISL, facilitated by a meticulously captured dataset comprising of different ranges of Indian Sign Language Gestures. Employing a sophisticated sequence-to-sequence RNN architecture enriched with Long Short-Term Memory (LSTM) components, it adeptly models the intricate temporal dynamics inherent in sign language. This also uses Gated Recurrent Unit(GRU) for processing of the information, and this is also used to overcome the vanishing gradient problem that is very common in RNN This innovative approach empowers the software to achieve unparalleled precision in recognizing ISL gestures, facilitated by comprehensive visual and motion-based data analysis techniques. Text to speech conversion is possible due to playsound library and gTTS library. This also helps in enhancing the project by voicing out loud the names of the gesture accurately. By harnessing cutting-edge technology, our software significantly bridges communication gaps and empowers individuals within the large spectrum of people who have hard to heard symptoms as well as permanent deafness Its accuracy and efficiency not only facilitate smoother interactions but also promote greater societal inclusivity. Thus, our software represents a significant step towards fostering a more accessible and inclusive environment for all members of society, regardless of their hearing abilities.