In this paper, we report our experiment on the designing of a 3D Chatbot that can be a way to relieve the stress that people faced in modern society. We aim to design a Chatbot that can be customized to meet different needs. Utilizing current artificial intelligence technology, our Chatbot can interact with the user in a role-playing way, by customize the text generation model via prompt engineering and with customize voice synthesis, the Chatbot can interact with users in the shape as a 3D game-like character. We integrate several AI technologies in our system, including voice recognition, image cognition, pre-trained large language model text generation, voice synthesis, and 3D character animation, such that our system can generate dialogue that fits the character and with actions expressing emotion coherent with the dialogue.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Integration of Conversational AI and Voice Synthesis for Enhanced Interactive Virtual Characters

  • Shih-Hung Wu,
  • Ping-Hsuan Lee,
  • Wen-Kai Shen,
  • Chi-Min Chou

摘要

In this paper, we report our experiment on the designing of a 3D Chatbot that can be a way to relieve the stress that people faced in modern society. We aim to design a Chatbot that can be customized to meet different needs. Utilizing current artificial intelligence technology, our Chatbot can interact with the user in a role-playing way, by customize the text generation model via prompt engineering and with customize voice synthesis, the Chatbot can interact with users in the shape as a 3D game-like character. We integrate several AI technologies in our system, including voice recognition, image cognition, pre-trained large language model text generation, voice synthesis, and 3D character animation, such that our system can generate dialogue that fits the character and with actions expressing emotion coherent with the dialogue.