Virtual Scribe for Visually Impaired Learners Through Interactive Speech-Based Application

Blind people face various challenges every day, something that people take for granted. One such problem that blind students face is the need for a scribe to write their exam. The onus falls on the blind student to find themselves a scribe which in itself is a difficult task. But even if a blind student has found a scribe, the scribes come with their own set of problems, such as linguistic capability and illegible handwriting. To solve this problem, V-Scribe or virtual scribe is being proposed which is a web application that would completely replace a human scribe. The application uses speech recognition, text-to-speech and a natural language understanding module to understand the requests given by the blind student and give back an appropriate response. The DIET classifier developed by Rasa is trained, obtaining an accuracy of 96.7% for intent recognition and 94.7% for entity recognition.