This study introduces “Alex,” a virtual assistant designed for seamless and natural interactions within a mixed reality (MR) environment. Leveraging advancements in voice command and speech recognition technologies, Alex incorporates a speech-to-text (STT) system and natural language processing (NLP) to transcribe and respond to user commands. The integration of a virtual assistant avatar enhances MR interactions, reducing the time needed for users to instantiate objects and enhancing collaborative telepresence experiences. The chapter presents a comprehensive list of voice commands and details testing in an MR application, providing an overview of the implementation of natural voice commands in MR. The study concludes with suggestions for future research, emphasizing the ongoing exploration and refinement of natural voice command applications in the MR landscape.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Alex: A Virtual Assistant for Natural Interaction in Mixed Reality Environment

  • Shafina Abd Karim Ishigaki,
  • Ajune Wanis Ismail,
  • Nur Ameerah Abdul Halim,
  • Md. Sah Hj Salam

摘要

This study introduces “Alex,” a virtual assistant designed for seamless and natural interactions within a mixed reality (MR) environment. Leveraging advancements in voice command and speech recognition technologies, Alex incorporates a speech-to-text (STT) system and natural language processing (NLP) to transcribe and respond to user commands. The integration of a virtual assistant avatar enhances MR interactions, reducing the time needed for users to instantiate objects and enhancing collaborative telepresence experiences. The chapter presents a comprehensive list of voice commands and details testing in an MR application, providing an overview of the implementation of natural voice commands in MR. The study concludes with suggestions for future research, emphasizing the ongoing exploration and refinement of natural voice command applications in the MR landscape.