2D-to-3D lifting methods have become the mainstream approach for estimating 3D human poses. While diffusion models have achieved remarkable success in single-frame image prediction, estimating 3D human poses in videos remains a significant challenge, particularly in scenes with long temporal sequences, severe occlusions, or rapid motion changes, where existing methods often struggle in terms of robustness and accuracy. In this paper, we propose DTFPose, a novel method that applies diffusion in both the temporal and frequency domains for 3D human pose estimation in videos. At its core, the Diffusion in Time and Frequency Domains (DiffTF) module fuses temporal and spectral features during the reverse diffusion process. Experimental results demonstrate that DTFPose achieves state-of-the-art performance on the Human3.6M and MPI-INF-3DHP datasets.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Diffusion in Time and Frequency Domains for Efficient 3D Human Pose Estimation in Videos

  • Yong Gu,
  • Yao Yao,
  • Longjie Huang

摘要

2D-to-3D lifting methods have become the mainstream approach for estimating 3D human poses. While diffusion models have achieved remarkable success in single-frame image prediction, estimating 3D human poses in videos remains a significant challenge, particularly in scenes with long temporal sequences, severe occlusions, or rapid motion changes, where existing methods often struggle in terms of robustness and accuracy. In this paper, we propose DTFPose, a novel method that applies diffusion in both the temporal and frequency domains for 3D human pose estimation in videos. At its core, the Diffusion in Time and Frequency Domains (DiffTF) module fuses temporal and spectral features during the reverse diffusion process. Experimental results demonstrate that DTFPose achieves state-of-the-art performance on the Human3.6M and MPI-INF-3DHP datasets.