Integration of a NLP-Based Industrial Robot Programming System

This paper presents the integration of a Natural Language Processing (NLP) approach with an industrial robot to enable voice control for online programming. This approach initially involves real-time conversion of voice commands into text, utilizing the Microsoft Speech Software Development Kit (SDK). The generated text is processed to extract numerical data corresponding to desired positions and orientations. Subsequently, a machine learning binary classification model is trained to distinguish between robot related and unrelated commands. The recognized commands undergo further keyword-based classification based on a preselected vocabulary of supported robot operations, so that finally the inverse kinematics problem can be solved and the relevant robot program can be generated. A custom graphical user interface (GUI) facilitates user interaction. Two modes are supported, the first for issuing multiple individual commands and the second for programming typical pick-and-place industrial tasks. The obtained results using a 6-DOF Staubli RX90L robot verify the approach’s feasibility.