<p>Existing meta-learning methods often struggle to generate accurate and information-dense prototypes due to the limited availability of novel class data, leading to decreased detection performance. Moreover, the Region Proposal Network (RPN) frequently fails to produce high-quality region proposals when faced with unstable feature representations and substantial intra-class feature variations. To address these challenges, we propose a novel few-shot object detection framework based on Dynamic Focused Prototypes Aggregation (DFPA). DFPA introduces a Bi-Level Routing Attention mechanism to extract prototypes from the support set, ensuring that the generated class-level prototypes are rich in detail. These prototypes are then aggregated into the feature map based on similarity, thereby enhancing feature representation before region proposal generation. In addition, we propose a Multi-Scale Convolutional Gated (MSCG) module, designed to improve the model’s sensitivity to targets of varying scales by capturing multi-scale features. MSCG also employs a convolutional gated mechanism to mitigate the negative effects of intra-class feature variations on the RPN. Experimental results demonstrated that on three novel class splits of the PASCAL VOC, the nAP50 of our method was improved by up to 2.3 percentage points compared with the baseline (Variational Feature Aggregation). Under the 30-shot setting of the MS COCO, nAP was increased by 0.8 percentage point compared to the meta-learning method SMPCCNet (Support-query Mutual Promotion and Classification Correction Network), achieving significant accuracy improvement in few-shot object detection.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Dynamic focused prototypes distillation for few-shot object detection

  • Binhong Xie,
  • Rui Wang,
  • Lihu Pan

摘要

Existing meta-learning methods often struggle to generate accurate and information-dense prototypes due to the limited availability of novel class data, leading to decreased detection performance. Moreover, the Region Proposal Network (RPN) frequently fails to produce high-quality region proposals when faced with unstable feature representations and substantial intra-class feature variations. To address these challenges, we propose a novel few-shot object detection framework based on Dynamic Focused Prototypes Aggregation (DFPA). DFPA introduces a Bi-Level Routing Attention mechanism to extract prototypes from the support set, ensuring that the generated class-level prototypes are rich in detail. These prototypes are then aggregated into the feature map based on similarity, thereby enhancing feature representation before region proposal generation. In addition, we propose a Multi-Scale Convolutional Gated (MSCG) module, designed to improve the model’s sensitivity to targets of varying scales by capturing multi-scale features. MSCG also employs a convolutional gated mechanism to mitigate the negative effects of intra-class feature variations on the RPN. Experimental results demonstrated that on three novel class splits of the PASCAL VOC, the nAP50 of our method was improved by up to 2.3 percentage points compared with the baseline (Variational Feature Aggregation). Under the 30-shot setting of the MS COCO, nAP was increased by 0.8 percentage point compared to the meta-learning method SMPCCNet (Support-query Mutual Promotion and Classification Correction Network), achieving significant accuracy improvement in few-shot object detection.