Digital aids based on image or object classification are very useful, providing visually impaired people help recognize nearby objects. Creating a system that provides audio feedback of the surrounding objects to the visually impaired, for the advancements in computer vision computing technology. In order to help the visually impaired and the blind, this study investigates Image Classification methods, as it can be very helpful for the their safety, quality of life and constant independence from other people.The Image Classification module recognizes 30 objects such as apple, bed, banana, cars, chair, dog, human, door_closed, door_opened, human_with_mask, tree, zebra_crossing, etc. and generates an audio feedback to the user by converting the classified text to speech using python. Android Studio development environment has been used for Android development. Work on the layout of the App has also been done using Android Studio.Online available dataset has been used for the evaluation of the Image Classification model. To increase the accuracy, clear, precise and more number of images in the data set have been used. To teach the model to classify images using files or webcam of Teachable Machine [5] is used. The models built with Teachable Machine are authentic TensorFlow.js models which function anywhere, where javascript is present, which makes them compatible with Glitch, P5.js, Node.js, and other tools. When we create our own classes, they transform into the final layer or segment of a neural network that has already been trained. Particularly, the image models are picking up knowledge from pre-trained mobilenet models.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Image Classification App for Visually Impaired with Audio Feedback

  • Saransh Jha,
  • Priyanshi Jain,
  • Nikhat Fatima Khan,
  • Vidhya Samad Barpha,
  • Jyoti Kukade

摘要

Digital aids based on image or object classification are very useful, providing visually impaired people help recognize nearby objects. Creating a system that provides audio feedback of the surrounding objects to the visually impaired, for the advancements in computer vision computing technology. In order to help the visually impaired and the blind, this study investigates Image Classification methods, as it can be very helpful for the their safety, quality of life and constant independence from other people.The Image Classification module recognizes 30 objects such as apple, bed, banana, cars, chair, dog, human, door_closed, door_opened, human_with_mask, tree, zebra_crossing, etc. and generates an audio feedback to the user by converting the classified text to speech using python. Android Studio development environment has been used for Android development. Work on the layout of the App has also been done using Android Studio.Online available dataset has been used for the evaluation of the Image Classification model. To increase the accuracy, clear, precise and more number of images in the data set have been used. To teach the model to classify images using files or webcam of Teachable Machine [5] is used. The models built with Teachable Machine are authentic TensorFlow.js models which function anywhere, where javascript is present, which makes them compatible with Glitch, P5.js, Node.js, and other tools. When we create our own classes, they transform into the final layer or segment of a neural network that has already been trained. Particularly, the image models are picking up knowledge from pre-trained mobilenet models.