Scholarlink

<p>Transformer-based object detection has attracted significant attention recently due to its promising performance. As the first work of DETR-like algorithms in the field of real time object detection, Real-Time Detection Transformer (RT-DETR) has achieved excellent performance on COCO val2017 and reached a new state of the art. However, when applied to new scenarios with significantly different imaging conditions and no annotated data, it often encounters challenges. To alleviate the issue of domain shift, this paper designs DA-RTDETR, an unsupervised domain adaptive RT-DETR method. DA-RTDETR consists of Feature Fusion Enhanced Discriminator (FFED) and Nonlinear Feature Constraint on category-level tokens (NFC). Specifically, FFED aligns multi-scale features from the backbone and encoder through hierarchical feature adaptation (HFA) and feature fusion (FF), enhancing the domain discrimination ability of the backbone and encoder. NFC extends the Deep CORAL loss to the category-level tokens of the decoder to minimize the difference in second-order statistics between the source and target domain. Our experiments on two challenging benchmarks demonstrate the effectiveness of our method, with a particularly notable relative improvement of 25.3<InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\%\)</EquationSource> <EquationSource Format="MATHML"><math> <mo>%</mo> </math></EquationSource> </InlineEquation> over the baseline on the Foggy Cityscapes dataset. Code is released at <a href="https://github.com/GodFish520/DA-RTDETR">https://github.com/GodFish520/DA-RTDETR</a>.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

DA-RTDETR: domain-adaptive RT-DETR with feature fusion and category-level constraints

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年11月25日

查看全文
  • Huantong Geng,
  • Yingrui Wang,
  • Zhenyu Liu,
  • Long Fang,
  • Zichen Fan

摘要

Transformer-based object detection has attracted significant attention recently due to its promising performance. As the first work of DETR-like algorithms in the field of real time object detection, Real-Time Detection Transformer (RT-DETR) has achieved excellent performance on COCO val2017 and reached a new state of the art. However, when applied to new scenarios with significantly different imaging conditions and no annotated data, it often encounters challenges. To alleviate the issue of domain shift, this paper designs DA-RTDETR, an unsupervised domain adaptive RT-DETR method. DA-RTDETR consists of Feature Fusion Enhanced Discriminator (FFED) and Nonlinear Feature Constraint on category-level tokens (NFC). Specifically, FFED aligns multi-scale features from the backbone and encoder through hierarchical feature adaptation (HFA) and feature fusion (FF), enhancing the domain discrimination ability of the backbone and encoder. NFC extends the Deep CORAL loss to the category-level tokens of the decoder to minimize the difference in second-order statistics between the source and target domain. Our experiments on two challenging benchmarks demonstrate the effectiveness of our method, with a particularly notable relative improvement of 25.3 \(\%\) % over the baseline on the Foggy Cityscapes dataset. Code is released at https://github.com/GodFish520/DA-RTDETR.