PGSR-DR: high-fidelity reflective surface reconstruction with planar-based Gaussians and deferred rendering
摘要
While 3D Gaussian Splatting (3DGS) has revolutionized novel-view synthesis, accurately recovering reflective surfaces remains a significant challenge due to inherent depth estimation errors and the limited capacity of spherical harmonics in representing high-frequency reflections. In this paper, we propose PGSR-DR, a reflection-aware framework that integrates planar-based Gaussian reconstruction with deferred rendering for high-fidelity geometry and appearance recovery. We first establish a reliable geometric foundation by introducing a depth-calculation method for planar-based Gaussians. Our method eliminates conventional estimation artifacts and incorporates joint depth-normal consistency and multi-view supervision to ensure global structural coherence. To capture intricate specularities, we incorporate a learnable environment map within a deferred rendering pipeline that uses Nvdiffrast for efficient sampling and explicit modeling of view-dependent appearances. Experimental results demonstrate that our method achieves competitive rendering quality and notably improved geometric accuracy for reflective surfaces, with planar-based Gaussian primitives closely adhering to the underlying surfaces while maintaining real-time performance.