This paper presents an innovative system for controlling a virtual mouse using hand gestures, complemented by voice feedback. Leveraging a standard webcam and computer vision techniques, the system interprets hand movements to perform pointer functions such as left and right clicks, volume and brightness adjustments, and file management. Developed with Python, OpenCV, and PyAutoGUI, this solution enhances accessibility, offering an intuitive and cost-effective interface for users, especially those with physical disabilities. The system’s robustness is validated under various conditions, ensuring a reliable and user-friendly experience in person-computer interaction.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Empowering Accessibility: An AI-Driven Virtual Mouse with Voice Feedback

  • Vahini Siruvoru,
  • Vijay Kumar Nampally,
  • Aishwarya Varma Kothapalli,
  • Nikhitha Reddy Sangasani,
  • Akshith Pallerla,
  • Balaji Karthikeya Yennavaram

摘要

This paper presents an innovative system for controlling a virtual mouse using hand gestures, complemented by voice feedback. Leveraging a standard webcam and computer vision techniques, the system interprets hand movements to perform pointer functions such as left and right clicks, volume and brightness adjustments, and file management. Developed with Python, OpenCV, and PyAutoGUI, this solution enhances accessibility, offering an intuitive and cost-effective interface for users, especially those with physical disabilities. The system’s robustness is validated under various conditions, ensuring a reliable and user-friendly experience in person-computer interaction.