<p>Gait recognition is valuable in a variety of applications, including social security, crime investigation, and video surveillance. However, gait recognition faces numerous external factors in real-world scenarios, including wearing overcoats, carrying conditions, and diverse viewing angles. Furthermore, distractors such as occlusions, crowds, and directional changes further increase the complexity. In recent years, numerous deep learning-based gait recognition methods have shown promising performance. However, these methods often employ a convolutional network with fixed weights for feature extraction, which inadequately addresses the dynamic localization of key regions and the extraction of robust local motion patterns. Additionally, the aggregation of complete motion patterns is neglected. In this paper, we present a new perspective suggesting that gait features include global motion patterns across multiple key regions, with each global motion pattern composed of a series of local motion patterns. To this end, we introduce a Motion Pattern Aggregation Network aimed at learning more discriminative features. Specifically, we employ a dynamic attention mechanism among neighboring pixel features, which adaptively focuses on key regions and generates expressive local motion patterns. Furthermore, we introduce a novel self-attention mechanism to select representative local motion patterns and then aggregate them according to the Nyquist-Shannon sampling theorem to acquire global motion patterns. Extensive experiments conducted in both laboratory and real-world settings have verified the effectiveness of the proposed method and highlighted the necessity of investigating the intrinsic hierarchical structure of motion patterns.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MPANet: Motion Pattern Aggregation Network for Gait Recognition

  • Kang Ma,
  • Xiao Liang,
  • Chunshui Cao,
  • Guoren Wang,
  • Dezhi Zheng

摘要

Gait recognition is valuable in a variety of applications, including social security, crime investigation, and video surveillance. However, gait recognition faces numerous external factors in real-world scenarios, including wearing overcoats, carrying conditions, and diverse viewing angles. Furthermore, distractors such as occlusions, crowds, and directional changes further increase the complexity. In recent years, numerous deep learning-based gait recognition methods have shown promising performance. However, these methods often employ a convolutional network with fixed weights for feature extraction, which inadequately addresses the dynamic localization of key regions and the extraction of robust local motion patterns. Additionally, the aggregation of complete motion patterns is neglected. In this paper, we present a new perspective suggesting that gait features include global motion patterns across multiple key regions, with each global motion pattern composed of a series of local motion patterns. To this end, we introduce a Motion Pattern Aggregation Network aimed at learning more discriminative features. Specifically, we employ a dynamic attention mechanism among neighboring pixel features, which adaptively focuses on key regions and generates expressive local motion patterns. Furthermore, we introduce a novel self-attention mechanism to select representative local motion patterns and then aggregate them according to the Nyquist-Shannon sampling theorem to acquire global motion patterns. Extensive experiments conducted in both laboratory and real-world settings have verified the effectiveness of the proposed method and highlighted the necessity of investigating the intrinsic hierarchical structure of motion patterns.