Empowering Gestures: Composing Succinct Meaning Using Vision and Swin Transformers for Indian Sign Language

Sign Language is the basal form of communication for the Hard-of- Hearing community. However, due to the lack of resources and interpreters, their ability to effectively communicate is often hindered. To address this issue, image processing technologies like Swin Transformers and Vision Transformers, which are recent developments in Computer Vision, can be employed. Sign Language translation is intended to facilitate communication for Hard-of-Hearing individuals by capturing, categorizing, and analyzing hand gestures used in sign language. The aim of this program is to create an automated program that can automatically translate Indian Sign Language (ISL) into written and audio content, thus eliminating the communication gap. With the help of Vision and Swin Transformers, which are known to provide a high level of accuracy, individuals will be able to recognize and interpret ISL gestures without the need for a professional translator.