Eha-detr: an enhanced hybrid attention transformer for small object detection in aerial images
摘要
Object detection in aerial imagery remains challenging due to the dominance of small objects, large scale variations, and the loss of spatial detail during deep feature extraction. While recent Detection Transformer (DETR) architectures have advanced end-to-end detection, they often suffer from weak spatial retention and limited multi-scale fusion in aerial scenes. To address these issues, we propose the Enhanced Hybrid Attention-based DETR (EHA-DETR). First, we design an Enhanced PConv–LFEM Network (EPLN) that integrates pinwheel-shaped convolution (PConv) and a Local Feature Enhancement Module (LFEM) to preserve directional and fine-grained cues, reducing the loss of features for small objects in the backbone. Then, we propose an Adaptive Multi-Scale Fusion Network (AMSFN) that employs learnable bidirectional fusion and spatial-aware weighting, integrating hierarchical features across scales with multi-kernel convolutions to enhance representations of small objects. Finally, we develop a Cross-Scale Feature Enhancement Module (CSFEM) that refines high-resolution features with multi-grained attention guided by high-level semantic features to improve representations of small objects. Experiments on three aerial benchmarks—VisDrone2019, CODrone, and SIMD—validate the effectiveness of EHA-DETR. On VisDrone2019, it achieves 40.6% mAP