Smart Glove for Word-Level Sign Language Recognition Using Flex Sensors, Accelerometer Sensors, and Long-Short Term Memory Model
摘要
Sign language is the easiest way to communicate between deaf people. There have been many studies on sign language recognition by computer vision, which, however, is not privacy-friendly and lacks user-friendliness. So, how can deaf individuals actively convey their meaning to people who do not understand sign language in an easy and practical way? In this paper, we propose a new method that can achieve this. The method involves a wearable device equipped with flex sensors and an accelerometer, combined with an LSTM model to recognize the words of people who are unable to speak. The model was trained and tested with 15 sign languages, including static and dynamic gestures. Finally, this project has been successfully implemented with 98% accuracy based on a training dataset recorded by the author within one hour and is capable of translating 15 word-level sign languages into speech in real time.