Indian Sign Language Bilateral Translator

Deaf and hard of hearing individuals face significant challenges and hardships in their daily lives due to their hearing loss, which significantly impact their quality of life in a negative way. Even though a lot of research has been done in sign languages used in countries like Britain and America, little has been done in Indian Sign Language. Hence, we have created a robust bilateral Indian Sign Language Translation system in order to convert Indian Sign Language to text and vice versa. The first model takes input in form of English text, which is further parsed to structure grammar representation on which grammar rules of Indian Sign Language are applied. The sentence is pre-processed and a concatenated video file will be generated for the sentence. For the second model, we have used LSTM model to predict gestures provided as input. To lessen the struggles faced by those who are deaf or hard of hearing, society must work toward greater accessibility, inclusivity, and understanding. For this reason, this research aims to enhance sign language detection and makes use of a production system to promote communication between deaf and hearing individuals.