Extreme Reality (EXR) is to superimpose extreme situations and live sensory data to the physical scene. In this study, we explore gesture capture and interaction technology for emergency response training, which includes extreme gaits such as crawling through the floor and real-time gesture control of the user’s movement in the training scenarios. Existing motion tracking systems heavily rely on wearable inertial motion units (IMUs) or head-mounted displays (HMDs), which adds both cost and physical burden to the user. This study examines a new multimodal Extreme Reality interface to support the real-time operation and training without the need for wearable equipment. In this study, we measured gesture detection latency, key point requirements, and accuracy with LiDAR and webcam for complex gesture recognition. Our experiments show that the usability of the Extreme Reality interfaces can be tested in a simulated environment and measured with instruments objectively.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Extreme Reality Training with Complex Gestures

  • Hsu-Wei Chen,
  • Yang Cai

摘要

Extreme Reality (EXR) is to superimpose extreme situations and live sensory data to the physical scene. In this study, we explore gesture capture and interaction technology for emergency response training, which includes extreme gaits such as crawling through the floor and real-time gesture control of the user’s movement in the training scenarios. Existing motion tracking systems heavily rely on wearable inertial motion units (IMUs) or head-mounted displays (HMDs), which adds both cost and physical burden to the user. This study examines a new multimodal Extreme Reality interface to support the real-time operation and training without the need for wearable equipment. In this study, we measured gesture detection latency, key point requirements, and accuracy with LiDAR and webcam for complex gesture recognition. Our experiments show that the usability of the Extreme Reality interfaces can be tested in a simulated environment and measured with instruments objectively.