This work explores sketching as a method for conveying human intentions in Human Robot Collaboration (HRC). We introduce SketchGuide, a vision-based system that enables users to sketch directly onto 3D surfaces using only their hands, without modifications to workers or workpieces. Using off-the-shelf components, our system captures 3D sketch geometry at interactive frame rates and operates independently of CAD information, offering flexibility across environments. We evaluated its effectiveness in programming robotic polishing tasks, demonstrating that sketching enhances human-robot collaboration.(Additional resources can be found at https://github.com/cheind/SketchGuide ).

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

SketchGuide: A Baseline Vision-Based Model for Rapid Robot Programming via Freehand Sketching on Any Surface

  • Christoph Heindl,
  • Gerhard Ebenhofer,
  • Sezgin Kutlu,
  • Fabian Widmoser,
  • Andreas Pichler

摘要

This work explores sketching as a method for conveying human intentions in Human Robot Collaboration (HRC). We introduce SketchGuide, a vision-based system that enables users to sketch directly onto 3D surfaces using only their hands, without modifications to workers or workpieces. Using off-the-shelf components, our system captures 3D sketch geometry at interactive frame rates and operates independently of CAD information, offering flexibility across environments. We evaluated its effectiveness in programming robotic polishing tasks, demonstrating that sketching enhances human-robot collaboration.(Additional resources can be found at https://github.com/cheind/SketchGuide ).