With the continuous improvement of consumer demand levels, users’ demand for automobiles has gradually shifted from a single travel tool to the “third space” in life. How to provide users with safe, efficient, and comfortable human-machine interaction experience in the intelligent cabin has become a new research focus. Multi-modal interaction integrates visual, auditory, tactile, gestural and other senses to fully simulate human-to-human interaction, which will become the mainstream of future human-machine interaction. This article summarizes the forms of interaction and proposes to improve driving efficiency and provide scenario-based intelligent interaction through multi-modal fusion and comprehensive processing of various information data, including vehicle status, user status, user demands, etc., to achieve more intelligent human-machine interaction in the cabin.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Application of Cockpit Human-Computer Interaction Based on Multi-Modal Fusion

  • Sui Qian,
  • Zhang Hua-sang,
  • Wan Juan,
  • Chen Chong,
  • Zhou Qian

摘要

With the continuous improvement of consumer demand levels, users’ demand for automobiles has gradually shifted from a single travel tool to the “third space” in life. How to provide users with safe, efficient, and comfortable human-machine interaction experience in the intelligent cabin has become a new research focus. Multi-modal interaction integrates visual, auditory, tactile, gestural and other senses to fully simulate human-to-human interaction, which will become the mainstream of future human-machine interaction. This article summarizes the forms of interaction and proposes to improve driving efficiency and provide scenario-based intelligent interaction through multi-modal fusion and comprehensive processing of various information data, including vehicle status, user status, user demands, etc., to achieve more intelligent human-machine interaction in the cabin.