A two-level modality fusion compensation network for visible-infrared person re-identification
摘要
Visible-Infrared Person Re-Identification (VI-ReID) is a challenging task due to the large modality discrepancy between two modalities. In view of this, a two-level modality fusion compensation network (TLMFC-Net) is proposed by us. Concretely, we first design an image-level fusion compensation module (ILFCM) for attenuating the impact of modality discrepancy at the image level by interactively fusing the visible image and infrared image to create auxiliary images that contain rich modality complementary information. Then, we design a feature-level fusion compensation module (FLFCM) for further attenuating the impact of modality discrepancy at the feature level by interactively fusing the visible features, infrared features, auxiliary visible features, and auxiliary infrared features to obtain auxiliary visible deep features and auxiliary infrared deep features. Furthermore, we design a local feature extraction module (LFEM) to learn fine-grained local pedestrian representations. Extensive experiments conducted on SYSU-MM01 and RegDB reveal that our method reaches the current advanced level. Codes are available at https://github.com/421893969/TLMFC-Net.