Scholarlink

In today’s evolving educational landscape, virtual classrooms demand innovative tools to enhance engagement and inclusivity. This study introduces a novel approach by integrating air-based drawing and live captioning to create a more interactive and accessible learning environment. Using computer vision for precise gesture recognition and hand tracking, supported by MediaPipe, the system enables instructors to draw in mid-air, with their movements captured and rendered in real time onto a virtual canvas. Additionally, speech-to-text technology converts spoken content into live captions, ensuring inclusivity for individuals with hearing impairments or language barriers. By seamlessly combining visual and textual elements, this paper enhances the clarity and effectiveness of online teaching, catering to diverse learning styles. Its versatile application extends beyond classrooms to collaborative learning environments and interactive e-learning platforms, paving the way for future innovations in digital education.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Virtual Air Drawing Using Computer Vision and Real-Time Captions for E-Learning

  • 会议论文

  • 发表日期：

    2026年

查看全文
  • M. Jayaram,
  • V. Jayasimha Reddy,
  • Ramavath Deepika,
  • Jarikot Rajendhar,
  • Kondaveeti Nikhil

摘要

In today’s evolving educational landscape, virtual classrooms demand innovative tools to enhance engagement and inclusivity. This study introduces a novel approach by integrating air-based drawing and live captioning to create a more interactive and accessible learning environment. Using computer vision for precise gesture recognition and hand tracking, supported by MediaPipe, the system enables instructors to draw in mid-air, with their movements captured and rendered in real time onto a virtual canvas. Additionally, speech-to-text technology converts spoken content into live captions, ensuring inclusivity for individuals with hearing impairments or language barriers. By seamlessly combining visual and textual elements, this paper enhances the clarity and effectiveness of online teaching, catering to diverse learning styles. Its versatile application extends beyond classrooms to collaborative learning environments and interactive e-learning platforms, paving the way for future innovations in digital education.