<p>In recent years, numerous studies on person re-identification (Re-ID) primarily emphasize visual appearance, leading to vulnerabilities like clothing changes, blurring, occlusions, and various other issues due to the reliance on visual cues. Earlier, promising methodologies encompass the integration of data from diverse modalities, such as gait silhouettes and infrared images, to alleviate the impact of imperfections in the visual data. Although gait is an important biometric features for human identification, effectively integrating them with RGB appearances remains challenging due to the substantial domain disparity. Rather than treating this as a new problem setting, we address the critical bottleneck of multimodal feature alignment. In this paper, we propose a novel and principled multimodal fusion strategy for person Re-ID. By introducing an efficient multimodal aware framework (MAF), our approach skillfully and automatically fuses RGB features with gait silhouette features without the need for explicit spatial calibration. To evaluate our approach, we introduce a new synthetic gait person Re-ID dataset, SGPR, involving RGB images and silhouettes. A comprehensive set of experiments has been conducted on multiple benchmark datasets and the results have clearly demonstrated the efficacy of our fusion strategy in this task.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing person re-identification with gait silhouettes

  • Dong Xi,
  • Li Li,
  • Wengang Zhou,
  • Houqiang Li

摘要

In recent years, numerous studies on person re-identification (Re-ID) primarily emphasize visual appearance, leading to vulnerabilities like clothing changes, blurring, occlusions, and various other issues due to the reliance on visual cues. Earlier, promising methodologies encompass the integration of data from diverse modalities, such as gait silhouettes and infrared images, to alleviate the impact of imperfections in the visual data. Although gait is an important biometric features for human identification, effectively integrating them with RGB appearances remains challenging due to the substantial domain disparity. Rather than treating this as a new problem setting, we address the critical bottleneck of multimodal feature alignment. In this paper, we propose a novel and principled multimodal fusion strategy for person Re-ID. By introducing an efficient multimodal aware framework (MAF), our approach skillfully and automatically fuses RGB features with gait silhouette features without the need for explicit spatial calibration. To evaluate our approach, we introduce a new synthetic gait person Re-ID dataset, SGPR, involving RGB images and silhouettes. A comprehensive set of experiments has been conducted on multiple benchmark datasets and the results have clearly demonstrated the efficacy of our fusion strategy in this task.