Gesture-Based Alphabet Detection and Scoring Using OpenCV and Tesseract-OCR

This paper presents a project that aims at improving the way in which children between the ages of 2–5 learn alphabets. The proposed solution is a program with a simple and user-friendly UI with an accurate scoring system. The project appeals to children and helps them learn at the same time using gestures. Using image detection technologies and gamification concepts, this project engages young learners in the alphabet learning process. Using the pre-existing technologies available to everyone, this project describes an innovative and powerful approach for learning alphabets. The gestures mimic how humans draw, and hence this project can prove to be a valuable resource in educating children. The program also uses audio cues to make this tedious process more interesting. The project gives an accuracy of 81.53% which is directly correlated to the accuracy of the PyTesseract library.