Multi-module collaborative 3D human body modeling algorithm based on PIFuHD
摘要
To address the limitations of existing 3D human body reconstruction methods in terms of insufficient precision and coarse detail construction, this paper proposes an optimized solution integrating temporal information, human behavior recognition, and multi-module collaboration. The algorithm centers on pixel-aligned hidden functions to establish a full-process reconstruction framework encompassing "temporal constraints-behavioral guidance-feature selection-attitude optimization-3D mapping-detail enhancement". By employing the SAD algorithm for optimal matching point selection and LSTM for temporal dependency capture, the algorithm achieves cross-frame feature coordination. Subsequently, the CNN-LSTM model performs human behavior recognition, using behavioral categories to guide SMPL model’s attitude parameter prior and attitude discriminator constraints. Posture normalization eliminates individual variations, while the integration of SMPL model and PIFuHD hidden function enables structured 3D mapping. Finally, octree acceleration grids are utilized to output high-precision 3D human models. Experimental results demonstrate that the proposed algorithm outperforms traditional and literature methods, achieving stable human detail construction in both static standing scenarios and dynamic running scenes.