3D Multimodal Socially Interactive Robot with ChatGPT Active Listening

Independent and autonomous at-home care can solve many current societal issues. However, with increased life expectancy and the rise of aging populations, further improvements to interactive robots are needed to increase Quality-of-Life. The standalone Toyota Human Support Robot has the ability to conduct independent at-home care. However, it lacks the establishment of autonomous social behaviors. We show that, by synthesizing a 3D multi-modal social interactive agent, it is capable of performing active listening in conjunction with the physical HSR. We perform a user analysis between social behaviors of standalone HSR and proposed by us – SIA-HSR. Experimental results have shown the effectiveness of our proposed approach, enhanced user experience, and improved rapport-building with HRI.