FIRE: Fine Implicit Reconstruction Enhancement with Detailed Body Part Labels and Geometric Features

While considerable progress has been made in 3D human reconstruction, existing methodologies exhibit performance limitations, mainly when dealing with complex clothing variations and challenging poses. In this paper, we propose an innovative approach that integrates fine-grained body part labels and geometric features into the reconstruction process, addressing the aforementioned challenges and boosting the overall performance. Our method, Fine Implicit Reconstruction Enhancement (FIRE), leverages blend weight-based soft human parsing labels and geometric features obtained through Ray-based Sampling to enrich the representation and predictive power of the reconstruction pipeline. We argue that incorporating these features provides valuable body part-specific information, which aids in improving the accuracy of the reconstructed model. Our work presents a subtle yet significant enhancement to current techniques, pushing the boundaries of performance and paving the way for future research in this intriguing field. Extensive experiments on various benchmarks demonstrate the effectiveness of our FIRE approach in terms of reconstruction accuracy, particularly in handling challenging poses and clothing variations. Our method’s versatility and improved performance render it a promising solution for diverse applications within the domain of 3D human body reconstruction.