The platform developed as an open-source project is intended for testing and deploying models of social agents designed to interact with humans. Test agents of any nature can be used, from scripts to cognitive architectures to deep neural networks, provided their function is social, user-related, and explainable in natural language (the test agent itself may not possess natural language capabilities). The implemented system enables remote multimodal social interactions between a test agent and human users that can occur in real-life settings. The idea is to integrate tools of OpenAI, Unreal Engine 5, and IT communicators in one system to give the agent a humanlike appearance and the abilities to communicate with users in natural language, to recognize and use intelligently tonalities of speech, facial expressions, and other modalities in social communication. This combined capability of the platform is vital for deploying emotionally intelligent cognitive architectures.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Platform for in-Depth Study of Social Interactions Between Users and Virtual Agents

  • Anatoly Dolgikh,
  • Anastasia Navrotskaya,
  • Alexei V. Samsonovich

摘要

The platform developed as an open-source project is intended for testing and deploying models of social agents designed to interact with humans. Test agents of any nature can be used, from scripts to cognitive architectures to deep neural networks, provided their function is social, user-related, and explainable in natural language (the test agent itself may not possess natural language capabilities). The implemented system enables remote multimodal social interactions between a test agent and human users that can occur in real-life settings. The idea is to integrate tools of OpenAI, Unreal Engine 5, and IT communicators in one system to give the agent a humanlike appearance and the abilities to communicate with users in natural language, to recognize and use intelligently tonalities of speech, facial expressions, and other modalities in social communication. This combined capability of the platform is vital for deploying emotionally intelligent cognitive architectures.