Voice-Based Collaborative Robot Interaction: A Modular, Speech-Based Interface Using LLMs
摘要
As the boundaries between human and machine interaction continue to blur, the need for intuitive and efficient interfaces becomes increasingly pressing. In industrial settings, collaborative robots (cobots) have emerged as pivotal tools in facilitating human-machine synergy. This paper presents a comprehensive design, implementation, and evaluation of a voice-controlled cobot interface using open-source software, speech recognition technologies, and large language models (LLMs). The system enables users to issue verbal commands, obtain audio feedback, inquire about process status, and even engage in casual conversation with the robot. By leveraging modular software architecture and locally deployed LLMs, the prototype offers a scalable and user-friendly solution. The study delves into the technical underpinnings, practical limitations, and future possibilities of hands-free robotic control, offering a contribution to the evolving field of human-robot interaction.