A Platform for in-Depth Study of Social Interactions Between Users and Virtual Agents
摘要
The platform developed as an open-source project is intended for testing and deploying models of social agents designed to interact with humans. Test agents of any nature can be used, from scripts to cognitive architectures to deep neural networks, provided their function is social, user-related, and explainable in natural language (the test agent itself may not possess natural language capabilities). The implemented system enables remote multimodal social interactions between a test agent and human users that can occur in real-life settings. The idea is to integrate tools of OpenAI, Unreal Engine 5, and IT communicators in one system to give the agent a humanlike appearance and the abilities to communicate with users in natural language, to recognize and use intelligently tonalities of speech, facial expressions, and other modalities in social communication. This combined capability of the platform is vital for deploying emotionally intelligent cognitive architectures.