Real-Time Tamil Fingerspelling Translation System: Image-to-Text Conversion and Speech Synthesis
摘要
This study presents a novel approach for recognizing and translating Tamil fingerspelling using image-to-text conversion and subsequent text-to-speech synthesis. Focusing on the Tamil Language Finger Spelling 23 (TLFS 23) dataset, which contains 247 characters depicting a wide array of Tamil fingerspelling gestures, we apply a multiclass classification process to develop an effective model for accurately identifying and transcribing images of fingerspelling into their corresponding textual forms. Following transcription, the text is converted into spoken Tamil through speech synthesis techniques to improve communication accessibility for Tamil-speaking individuals. The comprehensive evaluation conducted on the TFLS 23 dataset supports the method’s viability and effectiveness, significantly mitigating language barriers and enhancing communication within the Tamil fingerspelling community.