Scholarlink

To ensure safe and smooth human-robot interaction, autonomous robots operating around people often necessitate 3D human body orientation and bounding box estimation. An orientation of the human is generally defined by the motion around the yaw-axis. However, human-robot interaction tasks may necessitate different orientation definitions depending on the application, for instance an orientation can be defined using shoulder and hip joints. A 3D skeleton map, consisting of multiple 3D body joint coordinates, enables defining an orientation in diverse ways. However, estimating 3D skeleton maps from monocular images is computationally expensive. Existing approaches using large neural network models are impractical for real-time robot operation due to the limited onboard computation and power resources. In this paper, we automatically label the 3D human body orientation from 3D skeleton maps, and present a deep learning method to estimate 3D orientation and bounding box. We achieve this by leveraging a larger neural perception model to automatically generate an annotated training dataset, using a functional mapping from 3D skeleton joint coordinates to the defined orientation and bounding boxes. Experimental results demonstrate that our perception model estimates 3D human body orientation with an average error of 10.94 \(^\circ \) around the yaw-axis and the 3D bounding box with errors of 19.15% in width, 8.71% in length, and 4.71% in height compared to the annotator’s output, while doubling the FPS rate.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

3D Oriented Human Bounding Box Estimation via Monocular Vision and Auto-labeling by Large Pre-trained Neural Models

  • 会议论文

  • 发表日期：

    2025年

查看全文
  • Semih Orhan,
  • Elena Torta,
  • Ömür Arslan

摘要

To ensure safe and smooth human-robot interaction, autonomous robots operating around people often necessitate 3D human body orientation and bounding box estimation. An orientation of the human is generally defined by the motion around the yaw-axis. However, human-robot interaction tasks may necessitate different orientation definitions depending on the application, for instance an orientation can be defined using shoulder and hip joints. A 3D skeleton map, consisting of multiple 3D body joint coordinates, enables defining an orientation in diverse ways. However, estimating 3D skeleton maps from monocular images is computationally expensive. Existing approaches using large neural network models are impractical for real-time robot operation due to the limited onboard computation and power resources. In this paper, we automatically label the 3D human body orientation from 3D skeleton maps, and present a deep learning method to estimate 3D orientation and bounding box. We achieve this by leveraging a larger neural perception model to automatically generate an annotated training dataset, using a functional mapping from 3D skeleton joint coordinates to the defined orientation and bounding boxes. Experimental results demonstrate that our perception model estimates 3D human body orientation with an average error of 10.94 \(^\circ \) around the yaw-axis and the 3D bounding box with errors of 19.15% in width, 8.71% in length, and 4.71% in height compared to the annotator’s output, while doubling the FPS rate.