While kiosk usage has been increasing since the spread of COVID-19, the usage rate of the elderly has been only about half. In order to replace the menu-based touch-type kiosk, an interactive kiosk using virtual humans was proposed and implemented in this study. For the efficiency of implementation, the VHTK (Virtual Human Toolkit) developed by the USC (University of Southern California) is used to create virtual humans, and interactive voice synthesis and recognition functions for ordering and payment are implemented. We used Kakao's voice synthesis API as a voice input/output function. We also used the ‘Meta's Oculus Lip-sync’ to replace the existing character-based lip-sync function with a voice analysis-based lip-sync for the virtual human lip-sync animation. Using the developed program, we applied it to a kiosk that responds to customers at cafes. A preliminary experiment was conducted for usability evaluation. In the future, through this experiment, in-depth usability study is needed on the low-aged and elderly people who are uncomfortable using menu-based touch-type kiosks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Development of a Virtual Human Based Interactive Kiosk

  • Jae-Hwi Kwon,
  • Chang Joo Lim

摘要

While kiosk usage has been increasing since the spread of COVID-19, the usage rate of the elderly has been only about half. In order to replace the menu-based touch-type kiosk, an interactive kiosk using virtual humans was proposed and implemented in this study. For the efficiency of implementation, the VHTK (Virtual Human Toolkit) developed by the USC (University of Southern California) is used to create virtual humans, and interactive voice synthesis and recognition functions for ordering and payment are implemented. We used Kakao's voice synthesis API as a voice input/output function. We also used the ‘Meta's Oculus Lip-sync’ to replace the existing character-based lip-sync function with a voice analysis-based lip-sync for the virtual human lip-sync animation. Using the developed program, we applied it to a kiosk that responds to customers at cafes. A preliminary experiment was conducted for usability evaluation. In the future, through this experiment, in-depth usability study is needed on the low-aged and elderly people who are uncomfortable using menu-based touch-type kiosks.