<p>Due to small object sizes, dense distributions, and complex backgrounds in UAV imagery, existing object detection algorithms face significant challenges. This study introduces PAMA-DETR, an advanced object detection algorithm based on RT-DETR, designed for high precision and robustness. The designed efficient and lightweight Partial Attention Gate Network (PAGNet) improves extraction capabilities for small targets in complicated scenarios. PAGNet adopts an innovative single-head self-attention mechanism combined with convolutional gated linear unit (CGLU) to augment the capacity to distinguish small targets from the background. Recognizing the difficulty of fusing multi-scale features within dense scenes, we designed the multi-kernel adaptive feature fusion (MAFI) module. MAFI employs a multi-branch parallel architecture integrating diverse convolutional variants to establish multi-scale receptive fields, accommodating objects of various sizes. Additionally, we optimize the loss function by replacing GIoU with Inner-SIoU and further improve localization accuracy by constructing auxiliary bounding boxes. Experimental on VisDrone2019 and UAVDT datasets show that PAMA-DETR achieves superior performance compared to RT-DETR, with improvements of <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11227_2025_7985_Article_IEq1.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(3.2\%\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>3.2</mn> <mo>%</mo> </mrow> </math></EquationSource> </InlineEquation> and <InlineEquation ID="IEq2"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11227_2025_7985_Article_IEq2.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(3.9\%\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>3.9</mn> <mo>%</mo> </mrow> </math></EquationSource> </InlineEquation> in <InlineEquation ID="IEq3"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11227_2025_7985_Article_IEq3.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="50" /> </InlineMediaObject> <EquationSource Format="TEX">\(\text {mAP}_{50}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mtext>mAP</mtext> <mn>50</mn> </msub> </math></EquationSource> </InlineEquation>, and enhancements of <InlineEquation ID="IEq4"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11227_2025_7985_Article_IEq4.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(2.4\%\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>2.4</mn> <mo>%</mo> </mrow> </math></EquationSource> </InlineEquation> and <InlineEquation ID="IEq5"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11227_2025_7985_Article_IEq5.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(3.0\%\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>3.0</mn> <mo>%</mo> </mrow> </math></EquationSource> </InlineEquation> in <InlineEquation ID="IEq6"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11227_2025_7985_Article_IEq6.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="65" /> </InlineMediaObject> <EquationSource Format="TEX">\(\text {mAP}_{50:95}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mtext>mAP</mtext> <mrow> <mn>50</mn> <mo>:</mo> <mn>95</mn> </mrow> </msub> </math></EquationSource> </InlineEquation>, respectively. Notably, it decreases parameters by <InlineEquation ID="IEq7"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11227_2025_7985_Article_IEq7.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="43" /> </InlineMediaObject> <EquationSource Format="TEX">\(25.8\%\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>25.8</mn> <mo>%</mo> </mrow> </math></EquationSource> </InlineEquation> while achieving a <InlineEquation ID="IEq8"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="11227_2025_7985_Article_IEq8.gif" Format="GIF" Height="14" Rendition="HTML" Resolution="72" Type="Linedraw" Width="51" /> </InlineMediaObject> <EquationSource Format="TEX">\(97 \,\text {FPS}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>97</mn> <mspace width="0.166667em" /> <mtext>FPS</mtext> </mrow> </math></EquationSource> </InlineEquation> inference speed, exhibiting an effective trade-off between computational efficiency and detection accuracy.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

PAMA-DETR: a lightweight attention and multi-kernel feature fusion detection model for UAV images

  • Siwei Wei,
  • Wei Li,
  • Feifei Wei,
  • Chunzhi Wang

摘要

Due to small object sizes, dense distributions, and complex backgrounds in UAV imagery, existing object detection algorithms face significant challenges. This study introduces PAMA-DETR, an advanced object detection algorithm based on RT-DETR, designed for high precision and robustness. The designed efficient and lightweight Partial Attention Gate Network (PAGNet) improves extraction capabilities for small targets in complicated scenarios. PAGNet adopts an innovative single-head self-attention mechanism combined with convolutional gated linear unit (CGLU) to augment the capacity to distinguish small targets from the background. Recognizing the difficulty of fusing multi-scale features within dense scenes, we designed the multi-kernel adaptive feature fusion (MAFI) module. MAFI employs a multi-branch parallel architecture integrating diverse convolutional variants to establish multi-scale receptive fields, accommodating objects of various sizes. Additionally, we optimize the loss function by replacing GIoU with Inner-SIoU and further improve localization accuracy by constructing auxiliary bounding boxes. Experimental on VisDrone2019 and UAVDT datasets show that PAMA-DETR achieves superior performance compared to RT-DETR, with improvements of \(3.2\%\) 3.2 % and \(3.9\%\) 3.9 % in \(\text {mAP}_{50}\) mAP 50 , and enhancements of \(2.4\%\) 2.4 % and \(3.0\%\) 3.0 % in \(\text {mAP}_{50:95}\) mAP 50 : 95 , respectively. Notably, it decreases parameters by \(25.8\%\) 25.8 % while achieving a \(97 \,\text {FPS}\) 97 FPS inference speed, exhibiting an effective trade-off between computational efficiency and detection accuracy.