An Efficient Approach for Synthesizing 3D Human Models from 2D Moving Camera Images
摘要
The research and application of 2D-to-3D image conversion technology serve as a crucial foundation, significantly enhancing UAV systems’ intelligence, autonomy, safety, and operational efficiency within the aerial access field. In this study, we address the problem of 3D human mesh recovery from single RGB images by building upon the Human Mesh Recovery (HMR) framework. We propose two novel extensions: HMR \(_{KTD}\) , which incorporates hierarchical regression based on kinematic tree structures, and HMR \(_{TFM}\) , which integrates an attention-based mechanism for pose estimation. Although HMR \(_{TFM}\) faces challenges related to overfitting, HMR \(_{KTD}\) demonstrates improved performance over the original HMR. Furthermore, we explore the HMR \(_{INT}\) model, which leverages pretrained Vision Transformers (ViT) and independent prior tokens for pose, shape, and camera parameters. Experimental results on public datasets (3DPW, MPI-INF-3DHP, and Human 3.6M) validate the effectiveness of our approaches.