Cross-modal person re-identification aims to achieve accurate identity matching through cross-modal data (e.g., visible and infrared images), holding significant application value in intelligent security systems. However, existing methods predominantly rely on dual-stream networks to extract spatial domain features while inadequately exploring frequency domain information, making it challenging to effectively mitigate feature distribution shifts caused by modality discrepancies. This paper proposes a Frequency-Spatial Dual-Stream Fusion Network (FSFN) that enhances cross-modal matching performance by exploring modality-invariant feature representations in the frequency domain. Specifically, spatial features of visible and infrared modalities are first extracted through dual-stream network branches, while Fast Fourier Transform (FFT) is introduced to decompose images into amplitude and phase spectra. Subsequently, an attention-based feature fusion module is designed to enhance cross-modal feature consistency using structural information embedded in phase components, achieving complementary optimization of spatial-frequency features. Experiments demonstrate that on SYSU-MM01 and RegDB datasets, the proposed method achieves Rank-1/mAP accuracies of 66.01%/63.41% and 87.12%/79.97%, respectively, showing significant improvements over baseline approaches. This study provides a novel frequency-domain perspective for cross-modal feature learning.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Frequency-Spatial Dual-Stream Fusion Network for Visible-Infrared Person Re-identification

  • Renjie Zhou,
  • Kaixiong Xu,
  • Yi Chai

摘要

Cross-modal person re-identification aims to achieve accurate identity matching through cross-modal data (e.g., visible and infrared images), holding significant application value in intelligent security systems. However, existing methods predominantly rely on dual-stream networks to extract spatial domain features while inadequately exploring frequency domain information, making it challenging to effectively mitigate feature distribution shifts caused by modality discrepancies. This paper proposes a Frequency-Spatial Dual-Stream Fusion Network (FSFN) that enhances cross-modal matching performance by exploring modality-invariant feature representations in the frequency domain. Specifically, spatial features of visible and infrared modalities are first extracted through dual-stream network branches, while Fast Fourier Transform (FFT) is introduced to decompose images into amplitude and phase spectra. Subsequently, an attention-based feature fusion module is designed to enhance cross-modal feature consistency using structural information embedded in phase components, achieving complementary optimization of spatial-frequency features. Experiments demonstrate that on SYSU-MM01 and RegDB datasets, the proposed method achieves Rank-1/mAP accuracies of 66.01%/63.41% and 87.12%/79.97%, respectively, showing significant improvements over baseline approaches. This study provides a novel frequency-domain perspective for cross-modal feature learning.