Personal AI Desktop Assistant for Physically Challenged (DeskMate)
摘要
The proposed work presents DeskMate, an AI-powered desktop assistant designed for physically challenged individuals, supporting both voice and gesture-based control. Unlike conventional assistants, DeskMate integrates speech recognition, natural language processing, and computer vision for multimodal interaction. The proposed system enhances accessibility by offering flexible communication modes (speech and gesture), enabling users with varied impairments to interact with their desktop environment effectively. We provide an overview of the system design, architecture, and preliminary evaluation results to demonstrate its usability and performance.