The integration of robotics and ML is driving innovation in digital manufacturing. Robotic welding benefits from precise defect detection and monitoring. Tack welds, crucial in pre-welding assembly, can affect final weld quality if improperly formed and unaccounted for while welding over them, making its rapid detection essential. Leveraging TinyML for on-device inference enables immediate tack weld detection using a welding camera, eliminating reliance on high-latency cloud processing. This study integrates TinyML-based tack weld detection on a Renesas EK-RA6M5 platform running micro-ROS. By leveraging convolutional neural networks and the Edge Impulse platform, a model to classify tack weld online is developed. During development, the model reached an estimated F1-score of 98.7%, 10 ms inference time, and minimal resource use (75.2 KB RAM, 78.3 KB Flash). In real-world deployment, an inference time of 80 ms was achieved, with RAM and Flash usage at 330 KB and 230 KB, respectively. Despite higher computational demands, the system maintained respectable accuracy and responsiveness, confirming its viability on-board for edge analytics. This on-device solution reduces latency, enhances autonomy, and provides a foundation for future advancements in autonomous robotic welding.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

TinyML-Powered Tack Weld Detection for Robotic Welding

  • Hizza Waseem,
  • Di Wu,
  • Eric Coatanéa,
  • Joe David

摘要

The integration of robotics and ML is driving innovation in digital manufacturing. Robotic welding benefits from precise defect detection and monitoring. Tack welds, crucial in pre-welding assembly, can affect final weld quality if improperly formed and unaccounted for while welding over them, making its rapid detection essential. Leveraging TinyML for on-device inference enables immediate tack weld detection using a welding camera, eliminating reliance on high-latency cloud processing. This study integrates TinyML-based tack weld detection on a Renesas EK-RA6M5 platform running micro-ROS. By leveraging convolutional neural networks and the Edge Impulse platform, a model to classify tack weld online is developed. During development, the model reached an estimated F1-score of 98.7%, 10 ms inference time, and minimal resource use (75.2 KB RAM, 78.3 KB Flash). In real-world deployment, an inference time of 80 ms was achieved, with RAM and Flash usage at 330 KB and 230 KB, respectively. Despite higher computational demands, the system maintained respectable accuracy and responsiveness, confirming its viability on-board for edge analytics. This on-device solution reduces latency, enhances autonomy, and provides a foundation for future advancements in autonomous robotic welding.