Visible-infrared person re-identification focuses on matching identities across visible and infrared images, with the key challenge being extracting discriminative features across modalities. To tackle this, we propose an Automatic Visual-Language Aligning Network (AVLA). It leverages a multi-modal pre-trained model to automatically generate text descriptions for pedestrians during training, and incorporates an Image-Text Dynamic Attention (ITDA) module to categorize and fuse features by modality. Additionally, we design weighted distribution matching (WDM) to align visual and textual embeddings globally. Extensive experiments on public datasets demonstrate that our method outperforms existing approaches.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Automatic Visual-Language Aligning Network for Visible-Infrared Person Re-identification

  • Qihan Chen,
  • Guifang Zhang,
  • Dingyue Liu,
  • Yuming Fang

摘要

Visible-infrared person re-identification focuses on matching identities across visible and infrared images, with the key challenge being extracting discriminative features across modalities. To tackle this, we propose an Automatic Visual-Language Aligning Network (AVLA). It leverages a multi-modal pre-trained model to automatically generate text descriptions for pedestrians during training, and incorporates an Image-Text Dynamic Attention (ITDA) module to categorize and fuse features by modality. Additionally, we design weighted distribution matching (WDM) to align visual and textual embeddings globally. Extensive experiments on public datasets demonstrate that our method outperforms existing approaches.