Scholarlink

This project tackles the educational challenges faced by the hearing-impaired community by innovatively developing an AI+VR inclusive education support system, which aims to overcome the limitations of traditional education. The system’s core technologies include real-time speech-to-sign language animation, 3D knowledge visualization, and bidirectional sign language-to-speech translation, creating a fully accessible cognitive support framework. It supports a multimodal architecture and dialect adaptation, covering the seven major linguistic regions in China, and features a VR digital twin teacher module. Through this system, we effectively address the shortage of special education teachers and improve information reception efficiency by 58%. The project not only advances educational equity but also promotes inclusive education for both hearing and hearing-impaired communities, ensuring equal participation of people with disabilities in societal development.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Inclusive Campus Innovation Program for Deaf and Non-speaking Students: I See It

  • 章节

  • 发表日期：

    2026年

查看全文
  • Yuhong Zhu,
  • Hao Zhu,
  • Xiya Liu,
  • Huiping Song,
  • Tong Xu

摘要

This project tackles the educational challenges faced by the hearing-impaired community by innovatively developing an AI+VR inclusive education support system, which aims to overcome the limitations of traditional education. The system’s core technologies include real-time speech-to-sign language animation, 3D knowledge visualization, and bidirectional sign language-to-speech translation, creating a fully accessible cognitive support framework. It supports a multimodal architecture and dialect adaptation, covering the seven major linguistic regions in China, and features a VR digital twin teacher module. Through this system, we effectively address the shortage of special education teachers and improve information reception efficiency by 58%. The project not only advances educational equity but also promotes inclusive education for both hearing and hearing-impaired communities, ensuring equal participation of people with disabilities in societal development.