<p>With deep learning advancements, UAV object detection has great potential in various fields. However, in complex conditions, such as nighttime or fog, small object details are easily obscured by the background, leading to feature loss. To address this, we propose a network based on Wavelet Transform (WT), called the Hierarchical Interactive Fusion Network (HIFNet). First, Wavelet Spatial Frequency Awareness (WSFA) is created to enhance the representation of small objects in complex backgrounds. WT captures edge textures using high-frequency components, while the attention mechanism focuses on target areas. WSFA combines these, using attention weights from high-frequency features to specifically enhance small object expression. Second, Hierarchical Interactive fusion feature pyramid network uses hierarchical interactive fusion technology. Cross-layer fusion enhances shallow and deep features in the backbone, while cross-stage fusion combines shallow details with deep semantics. Then, element-wise addition is used for deep interaction, preserving small details during feature sampling. Finally, the adaptive mixed (A-mixed) loss combines IoU and normalized Wasserstein distance (NWD) losses. It emphasizes small objects by adjusting NWD based on object area and dynamically balances the losses for optimization. Experimental results show HIFNet’s exceptional performance on three datasets, achieving <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11227_2025_7338_Article_IEq1.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="71" /> </InlineMediaObject> <EquationSource Format="TEX">\(\text {mAP}_{50-95}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mtext>mAP</mtext> <mrow> <mn>50</mn> <mo>-</mo> <mn>95</mn> </mrow> </msub> </math></EquationSource> </InlineEquation> scores of 35.5%, 57.1%, and 55.9%, respectively.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

HIFNet: wavelet transform-enhanced UAV object detection in complex conditions

  • Lei Shang,
  • Huan Lei,
  • Ze Wu,
  • Wenyuan Yang

摘要

With deep learning advancements, UAV object detection has great potential in various fields. However, in complex conditions, such as nighttime or fog, small object details are easily obscured by the background, leading to feature loss. To address this, we propose a network based on Wavelet Transform (WT), called the Hierarchical Interactive Fusion Network (HIFNet). First, Wavelet Spatial Frequency Awareness (WSFA) is created to enhance the representation of small objects in complex backgrounds. WT captures edge textures using high-frequency components, while the attention mechanism focuses on target areas. WSFA combines these, using attention weights from high-frequency features to specifically enhance small object expression. Second, Hierarchical Interactive fusion feature pyramid network uses hierarchical interactive fusion technology. Cross-layer fusion enhances shallow and deep features in the backbone, while cross-stage fusion combines shallow details with deep semantics. Then, element-wise addition is used for deep interaction, preserving small details during feature sampling. Finally, the adaptive mixed (A-mixed) loss combines IoU and normalized Wasserstein distance (NWD) losses. It emphasizes small objects by adjusting NWD based on object area and dynamically balances the losses for optimization. Experimental results show HIFNet’s exceptional performance on three datasets, achieving \(\text {mAP}_{50-95}\) mAP 50 - 95 scores of 35.5%, 57.1%, and 55.9%, respectively.