A UAV Detection in Complex Environments Method Based on Cross-Modal Fusion of Infrared and Visible images
摘要
Real-time, All-weather monitoring of unmanned aerial vehicles (UAVs) is crucial for ensuring low-altitude airspace security. Traditional single-modality detection systems often fail under challenging conditions such as night and adverse weather, leading to reduced accuracy. To address this, we propose LDD-YOLO, an improved YOLOv8 algorithm incorporating dynamic feature learning and enhanced feature fusion for dual-modality UAV detection. Our approach utilizes a dual-stream backbone to extract complementary features from infrared and visible modalities, a lightweight C2f-linear deformable convolution (LDC2f) module for improved feature extraction, and a dual feature enhancement (DFE) module to mitigate cross-modal interference. Additionally, we introduce a deformable convolution v4-Dynamic Head (DCNv4-DyHead) detection head to enhance multi-scale perception and localization accuracy. Experimental results on a self-constructed dataset of 11,490 paired infrared-visible UAV images demonstrate that the proposed LDD-YOLO model achieves real-time performance with only 6.43M parameters, demonstrating outstanding detection accuracy under adverse conditions and low-light environments. It achieves a map@50:95 of