Scholarlink

<p>Fine-grained visual classification (FGVC) involves classifying multiple subcategories within a unified major category, a task characterized by significant intra-class variability and minimal inter-class differences. Previous methods often rely on pre-trained visual models augmented with specialized modules, typically using large-scale models that are challenging for industrial deployment. Moreover, image data often comes with auxiliary information (e.g., spatiotemporal priors, attributes, and text descriptions), offering opportunities to enhance FGVC accuracy. Here we propose a novel lightweight Transformer-based approach that incorporates additional auxiliary information to enhance classification accuracy. Our method introduces a simplified pixel-focused aggregation attention to achieve local and global feature fusion and improves it with a separable aggregation attention to reduce model complexity. We also present the extra inside padding method for integrating auxiliary information with minimal additional parameters. Without pre-training, our model surpasses other lightweight neural networks on fine-grained datasets (e.g., a 5.3% increase in accuracy on CUB-200-2011), demonstrating a significant improvement. Our approach offers a promising direction for FGVC tasks, highlighting the effectiveness of integrating multimodal data for enhanced performance. Our source code is available at <a href="https://github.com/yang-zzy/SAA-EIP.">https://github.com/yang-zzy/SAA-EIP.</a></p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Enhanced fine-grained visual classification through lightweight Transformer integration and auxiliary information fusion

  • 期刊论文

  • 发表日期：

    2025年9月3日

查看全文
  • Zhenyang Zhu,
  • Li Li,
  • Ketai He

摘要

Fine-grained visual classification (FGVC) involves classifying multiple subcategories within a unified major category, a task characterized by significant intra-class variability and minimal inter-class differences. Previous methods often rely on pre-trained visual models augmented with specialized modules, typically using large-scale models that are challenging for industrial deployment. Moreover, image data often comes with auxiliary information (e.g., spatiotemporal priors, attributes, and text descriptions), offering opportunities to enhance FGVC accuracy. Here we propose a novel lightweight Transformer-based approach that incorporates additional auxiliary information to enhance classification accuracy. Our method introduces a simplified pixel-focused aggregation attention to achieve local and global feature fusion and improves it with a separable aggregation attention to reduce model complexity. We also present the extra inside padding method for integrating auxiliary information with minimal additional parameters. Without pre-training, our model surpasses other lightweight neural networks on fine-grained datasets (e.g., a 5.3% increase in accuracy on CUB-200-2011), demonstrating a significant improvement. Our approach offers a promising direction for FGVC tasks, highlighting the effectiveness of integrating multimodal data for enhanced performance. Our source code is available at https://github.com/yang-zzy/SAA-EIP.