RGB cameras, while widely used for human detection and pose estimation, face challenges in real-world applications due to sensitivity to illumination changes, low-light conditions, and motion blur. Moreover, deploying state-of-the-art models is hindered by privacy concerns and the high computational demands of RGB images, making them less suitable for real-time, resource-constrained environments. This paper investigates depth and event-based cameras as alternatives to RGB for human detection and pose estimation. These modalities offer advantages such as improved low-light performance and reduced privacy concerns. Event cameras, which capture pixel-level intensity changes at high temporal resolution, minimize motion blur and consume significantly less power and memory than RGB cameras, making them ideal for edge applications. We simulate depth and event-based data using the MS COCO dataset and retrain state-of-the-art models. Results show depth data performs similarly to RGB, while event-based data, though slightly less accurate, remains competitive. These findings highlight the potential of depth and event-based cameras for efficient, privacy-preserving human detection and pose estimation in real-world applications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Depth and Event-Based Approaches for Human Detection and Pose Estimation

  • Hao Quan,
  • Milad Goudarzi,
  • Chiara Plizzari,
  • Simone Mentasti,
  • Francesca Palermo,
  • Diana Trojaniello,
  • Matteo Matteucci

摘要

RGB cameras, while widely used for human detection and pose estimation, face challenges in real-world applications due to sensitivity to illumination changes, low-light conditions, and motion blur. Moreover, deploying state-of-the-art models is hindered by privacy concerns and the high computational demands of RGB images, making them less suitable for real-time, resource-constrained environments. This paper investigates depth and event-based cameras as alternatives to RGB for human detection and pose estimation. These modalities offer advantages such as improved low-light performance and reduced privacy concerns. Event cameras, which capture pixel-level intensity changes at high temporal resolution, minimize motion blur and consume significantly less power and memory than RGB cameras, making them ideal for edge applications. We simulate depth and event-based data using the MS COCO dataset and retrain state-of-the-art models. Results show depth data performs similarly to RGB, while event-based data, though slightly less accurate, remains competitive. These findings highlight the potential of depth and event-based cameras for efficient, privacy-preserving human detection and pose estimation in real-world applications.