Visual pattern discovery refers to capture re-occurring spatial structures of visual primitives, which have extensive applications in image analysis, such as object recognition, pedestrian search. For human-centric recognition task, the identification always composed of appearance attributes which lack of visual geometric correlations among body parts (e.g. right ankle in front of torso, left wrist is closer to head than right wrist). We explore to mine the semantic pose invariance called pose-aware pattern and get a universal understanding schema. And we propose a novel framework to discover pose-aware patterns and make use the higher-level cognition for human pose estimation. Concretely, the framework employs the notion of semantic pose consistency to quantify and generate external knowledge as visual words, and then learn to fit the discovered pose-aware transitive words to human pose estimation model through a transfer learning procedure. This paper investigate how to discover and how to use higher-level pose semantics, which can be extended to any pose estimation baselines. Furthermore, we report quantitative and qualitative results on pose analysis with pose retrievals in our built-up data source, and empirical evaluation demonstrates the effectiveness.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Fine-Grained Pose-Aware Pattern Discovering ConvNet for Human Pose Estimation

  • Yilei Chen,
  • Xuemei Xie

摘要

Visual pattern discovery refers to capture re-occurring spatial structures of visual primitives, which have extensive applications in image analysis, such as object recognition, pedestrian search. For human-centric recognition task, the identification always composed of appearance attributes which lack of visual geometric correlations among body parts (e.g. right ankle in front of torso, left wrist is closer to head than right wrist). We explore to mine the semantic pose invariance called pose-aware pattern and get a universal understanding schema. And we propose a novel framework to discover pose-aware patterns and make use the higher-level cognition for human pose estimation. Concretely, the framework employs the notion of semantic pose consistency to quantify and generate external knowledge as visual words, and then learn to fit the discovered pose-aware transitive words to human pose estimation model through a transfer learning procedure. This paper investigate how to discover and how to use higher-level pose semantics, which can be extended to any pose estimation baselines. Furthermore, we report quantitative and qualitative results on pose analysis with pose retrievals in our built-up data source, and empirical evaluation demonstrates the effectiveness.