Integration of Conversational AI and Voice Synthesis for Enhanced Interactive Virtual Characters
摘要
In this paper, we report our experiment on the designing of a 3D Chatbot that can be a way to relieve the stress that people faced in modern society. We aim to design a Chatbot that can be customized to meet different needs. Utilizing current artificial intelligence technology, our Chatbot can interact with the user in a role-playing way, by customize the text generation model via prompt engineering and with customize voice synthesis, the Chatbot can interact with users in the shape as a 3D game-like character. We integrate several AI technologies in our system, including voice recognition, image cognition, pre-trained large language model text generation, voice synthesis, and 3D character animation, such that our system can generate dialogue that fits the character and with actions expressing emotion coherent with the dialogue.