Hand Gesture Recognition System with Voice Commands for Desktop Control

In recent years, Artificial Intelligence (AI) has revolutionized many industries, particularly in software industry. Hand gestures have gained significance in AI, with gesture control being widely popular. Presently, many devices offer separate interfaces for gestures and voice commands. The combining of these abilities is getting noticed, making it easier to interact with technology. This system proposes an advanced human-computer interaction system, enhancing user experience through voice and gesture controls. In contrast to systems utilizing solely gesture recognition for command execution, this system integrates voice recognition for hands-free operation. Utilizing CNN (Convolutional Neural Network) and MediaPipe library for gestures and a combination of CNN and RNN (Recurrent Neural Network) for Voice Recognition, this system aims to offer seamless interaction, enabling effortless communication through natural language and gestures. This innovative approach ensures enhanced accessibility and efficiency, providing users with a more immersive computing experience.