Human-computer interaction plays a crucial role in daily activities, underscoring the importance of developing intuitive, adaptable, and precise interaction mechanisms. In this work, we present a novel vision-based input device that leverages computer vision techniques and fiducial object pose estimation to enable seamless user interaction with digital systems. This input device aims to capture a wide range of user actions and translate them into system commands, offering a natural and adaptable means of interaction. To achieve this, we designed an interactive experience where users can manipulate and interact with different 3D objects using our developed input device. By providing an accessible and engaging alternative to conventional input methods, this system can reduce the barriers encountered by students with diverse needs. A preliminary user study conducted with several participants demonstrated high satisfaction, emphasizing the system’s fluidity, intuitiveness, and ease of use. These findings suggest that vision-based input devices hold significant potential for enhancing interaction paradigms in both educational and general-purpose computing environments.