In this article, we propose a vision based unmanned aerial vehicle automatic positioning and tracking system, and to use precise control algorithms to keep the unmanned aerial vehicle directly above the legged robot during the landing process, ultimately achieving precise landing. The research mainly includes the following five aspects: YOLO based object detection and recognition of a quadruped robots with Slicing Aided Hyper Inference (SAHI), relative position estimation between unmanned aerial vehicles (quadrotors) and quadruped robots, motion trajectory prediction and control strategies, combination of MPC (Model Predictive Control) and PID control algorithms, autonomous landing and error correction of quadrotors, all under Image-based visual-servo (IBVS) control.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Visual Detection and Tracking of Quadruped Robot from Quadrotor Using YOLOv8 with SAHI and IBVS

  • Yujie Xie,
  • Jiajun Yang,
  • Fangze Li,
  • Boo Cheong Khoo,
  • Sutthiphong Srigrarom

摘要

In this article, we propose a vision based unmanned aerial vehicle automatic positioning and tracking system, and to use precise control algorithms to keep the unmanned aerial vehicle directly above the legged robot during the landing process, ultimately achieving precise landing. The research mainly includes the following five aspects: YOLO based object detection and recognition of a quadruped robots with Slicing Aided Hyper Inference (SAHI), relative position estimation between unmanned aerial vehicles (quadrotors) and quadruped robots, motion trajectory prediction and control strategies, combination of MPC (Model Predictive Control) and PID control algorithms, autonomous landing and error correction of quadrotors, all under Image-based visual-servo (IBVS) control.