As the boundaries between human and machine interaction continue to blur, the need for intuitive and efficient interfaces becomes increasingly pressing. In industrial settings, collaborative robots (cobots) have emerged as pivotal tools in facilitating human-machine synergy. This paper presents a comprehensive design, implementation, and evaluation of a voice-controlled cobot interface using open-source software, speech recognition technologies, and large language models (LLMs). The system enables users to issue verbal commands, obtain audio feedback, inquire about process status, and even engage in casual conversation with the robot. By leveraging modular software architecture and locally deployed LLMs, the prototype offers a scalable and user-friendly solution. The study delves into the technical underpinnings, practical limitations, and future possibilities of hands-free robotic control, offering a contribution to the evolving field of human-robot interaction.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Voice-Based Collaborative Robot Interaction: A Modular, Speech-Based Interface Using LLMs

  • Anna Syberfeldt,
  • Eric Svensson

摘要

As the boundaries between human and machine interaction continue to blur, the need for intuitive and efficient interfaces becomes increasingly pressing. In industrial settings, collaborative robots (cobots) have emerged as pivotal tools in facilitating human-machine synergy. This paper presents a comprehensive design, implementation, and evaluation of a voice-controlled cobot interface using open-source software, speech recognition technologies, and large language models (LLMs). The system enables users to issue verbal commands, obtain audio feedback, inquire about process status, and even engage in casual conversation with the robot. By leveraging modular software architecture and locally deployed LLMs, the prototype offers a scalable and user-friendly solution. The study delves into the technical underpinnings, practical limitations, and future possibilities of hands-free robotic control, offering a contribution to the evolving field of human-robot interaction.