Children arriving at hospitals for treatment often experience nervousness and discomfort. To mitigate this, we introduced a humanoid robot as an interactive storyteller, narrating stories generated dynamically by a generative AI, incorporating inputs from the child during the conversation. The interactivity was further enhanced by aligning the emotional tone of the narrative with synchronized facial expressions and arm gestures of the robot, generated by utilizing a classifier network. This paper presents the technical implementation of the system and reports preliminary findings from pilot tests conducted at Odense University Hospital and the University of Southern Denmark. The results indicate that the robot was effective in delivering stories and maintaining children’s attention, promising positive outcomes for the use of interactive robotics in pediatric care settings.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

RoboTale: Leveraging Large Language Models for Generative Storytelling and Gestural Interaction on a Humanoid Robot for Children’s Hospitals

  • Pol Barrera Valls,
  • John Allan Øllgaard,
  • Tabea Sudermann,
  • Angelina Stoyanova Wolf,
  • Ricki Kenn Rasmussen,
  • Leon Bodenhagen,
  • Oskar Palinko

摘要

Children arriving at hospitals for treatment often experience nervousness and discomfort. To mitigate this, we introduced a humanoid robot as an interactive storyteller, narrating stories generated dynamically by a generative AI, incorporating inputs from the child during the conversation. The interactivity was further enhanced by aligning the emotional tone of the narrative with synchronized facial expressions and arm gestures of the robot, generated by utilizing a classifier network. This paper presents the technical implementation of the system and reports preliminary findings from pilot tests conducted at Odense University Hospital and the University of Southern Denmark. The results indicate that the robot was effective in delivering stories and maintaining children’s attention, promising positive outcomes for the use of interactive robotics in pediatric care settings.