Neural Imitation of Model Predictive Control for Vision-Based Guidance of Agile Micro Air Vehicles in Film Production
摘要
Ground-target tracking using aerial robots, particularly quadrotors, is widely applied in surveillance and cinematic filming. Despite advances in machine vision, existing tracking approaches often suffer from inaccuracies caused by occlusion, motion blur, and changing illumination during UAV maneuvers.
PurposeThis study aims to develop a robust and efficient vision-based tracking framework that improves tracking accuracy and stability under challenging conditions such as occlusion and rapid motion. Specifically, the work seeks to enhance UAV tracking performance by integrating advanced visual tracking with predictive control and reducing computational complexity through learning-based control.
MethodsA vision-based tracking framework is proposed that integrates the Discriminative Model Prediction (DiMP) tracker with Model Predictive Control (MPC). The DiMP tracker estimates future target motion probabilities and adapts dynamically when the target reappears after occlusion, ensuring reliable tracking under high-speed and visually challenging conditions. Visual feedback is incorporated into MPC to enable predictive trajectory adjustments based on real-time observations. A neural imitation learning controller trained to improve system efficiency.
ResultsExperimental evaluation demonstrates that the proposed DiMP–MPC framework significantly outperforms conventional MPC-based approaches. Tracking precision increased from 49.7% to 68.9%, trajectory error was reduced by approximately 3%, and smoother camera motion was achieved, particularly during occlusion recovery. The imitation learning-based controller further reduced computational cost while maintaining robust tracking performance.
ConclusionThe proposed DiMP–MPC framework provides a robust, efficient, and accurate solution for vision-based UAV target tracking. This approach offers a practical and scalable solution for real-world aerial tracking applications.