<p>A multi-agent system is a system in which multiple agents cooperate to achieve a global objective. Each agent within the system can move independently and exchange information with other agents to collaborate in executing tasks. As an entertainment application of multi-agent systems, previous research has been conducted to realize a mass game in which a group of small robots displays static images. Additionally, with the recent advancements in text-to-image generative models (e.g., stable diffusion), image generative AI has rapidly gained popularity across various fields. In this paper, we propose ChatRAD, a system that integrates image generative AI with a multi-agent system, allowing a group of robots to display animations based on text input from users. We describe the detailed structure and functionality of the system, as well as the control laws governing the robot swarm. Numerical experiments are conducted using multiple target animations to evaluate the system’s performance. Furthermore, to enhance the quality of the displayed animations, we apply Bayesian optimization for gain tuning and verify its effectiveness using image evaluation indices.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

ChatRAD: a robotic animation display system with text-to-image generative AI

  • Masahiro Ishikane,
  • Yanchun Li,
  • Yuki Minami,
  • Shinsaku Izumi,
  • Masato Ishikawa

摘要

A multi-agent system is a system in which multiple agents cooperate to achieve a global objective. Each agent within the system can move independently and exchange information with other agents to collaborate in executing tasks. As an entertainment application of multi-agent systems, previous research has been conducted to realize a mass game in which a group of small robots displays static images. Additionally, with the recent advancements in text-to-image generative models (e.g., stable diffusion), image generative AI has rapidly gained popularity across various fields. In this paper, we propose ChatRAD, a system that integrates image generative AI with a multi-agent system, allowing a group of robots to display animations based on text input from users. We describe the detailed structure and functionality of the system, as well as the control laws governing the robot swarm. Numerical experiments are conducted using multiple target animations to evaluate the system’s performance. Furthermore, to enhance the quality of the displayed animations, we apply Bayesian optimization for gain tuning and verify its effectiveness using image evaluation indices.