The proposed work presents DeskMate, an AI-powered desktop assistant designed for physically challenged individuals, supporting both voice and gesture-based control. Unlike conventional assistants, DeskMate integrates speech recognition, natural language processing, and computer vision for multimodal interaction. The proposed system enhances accessibility by offering flexible communication modes (speech and gesture), enabling users with varied impairments to interact with their desktop environment effectively. We provide an overview of the system design, architecture, and preliminary evaluation results to demonstrate its usability and performance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Personal AI Desktop Assistant for Physically Challenged (DeskMate)

  • Anitha Julian,
  • Beauty Kumari,
  • Gerardine Immaculate Mary,
  • Mayur Rele

摘要

The proposed work presents DeskMate, an AI-powered desktop assistant designed for physically challenged individuals, supporting both voice and gesture-based control. Unlike conventional assistants, DeskMate integrates speech recognition, natural language processing, and computer vision for multimodal interaction. The proposed system enhances accessibility by offering flexible communication modes (speech and gesture), enabling users with varied impairments to interact with their desktop environment effectively. We provide an overview of the system design, architecture, and preliminary evaluation results to demonstrate its usability and performance.