Scholarlink

<b>Purpose:</b> <p>Accurate 3D reconstruction from endoscopic videos is crucial for advancing computer-assisted minimally invasive surgery. However, existing approaches struggle with dynamic surgical scenes where instrument occlusions cause significant reconstruction artifacts. Although 3D Gaussian Splatting (3DGS) enables rapid reconstruction, it often suffers from incomplete surface recovery due to occlusion-induced missing regions and error propagation from suboptimal initial point clouds during radiance field optimization. This study aims to enhance reconstruction accuracy in dynamically occluded surgical environments.</p> <b>Methods:</b> <p>We propose a diffusion-guided Gaussian Splatting (DiGS) framework comprising two key components: (1) a diffusion-guided surface completion network that incorporates surgical scene priors to restore high-fidelity textures in occluded regions, improving surface completeness; and (2) a lightweight annealed smoothing mechanism designed to mitigate endoscope motion estimation errors, ensuring temporal coherence during continuous frame interpolation and stabilizing radiance field optimization.</p> <b>Results:</b> <p>Extensive experiments on the EndoNeRF and StereoMIS datasets demonstrate the superiority of DiGS over state-of-the-art baselines. On EndoNeRF, DiGS achieves a 61.75% improvement in LPIPS, indicating stronger perceptual alignment in dynamically occluded scenes. On StereoMIS, DiGS delivers an 7.03% PSNR gain and a 40.79% LPIPS improvement, along with consistently higher SSIM scores confirming superior preservation of structural details.</p> <b>Conclusion:</b> <p>The proposed DiGS framework effectively addresses the challenges of dynamic occlusions and motion-induced errors in surgical scene reconstruction, producing more accurate and temporally coherent 3D models. The code is publicly available at <a href="https://github.com/IGSResearch/DiGS">https://github.com/IGSResearch/DiGS</a>.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Digs: diffusion-guided Gaussian Splatting for dynamic occlusion surgical scene reconstruction

  • 期刊论文

  • 发表日期：

    2026年1月30日

查看全文
  • Huoling Luo,
  • Xiangling Nan,
  • Jiahao Yang,
  • Changmiao Wang,
  • Tianqiao Zhang,
  • Yingfang Fan,
  • Fucang Jia,
  • Qin Zhang

摘要

Purpose:

Accurate 3D reconstruction from endoscopic videos is crucial for advancing computer-assisted minimally invasive surgery. However, existing approaches struggle with dynamic surgical scenes where instrument occlusions cause significant reconstruction artifacts. Although 3D Gaussian Splatting (3DGS) enables rapid reconstruction, it often suffers from incomplete surface recovery due to occlusion-induced missing regions and error propagation from suboptimal initial point clouds during radiance field optimization. This study aims to enhance reconstruction accuracy in dynamically occluded surgical environments.

Methods:

We propose a diffusion-guided Gaussian Splatting (DiGS) framework comprising two key components: (1) a diffusion-guided surface completion network that incorporates surgical scene priors to restore high-fidelity textures in occluded regions, improving surface completeness; and (2) a lightweight annealed smoothing mechanism designed to mitigate endoscope motion estimation errors, ensuring temporal coherence during continuous frame interpolation and stabilizing radiance field optimization.

Results:

Extensive experiments on the EndoNeRF and StereoMIS datasets demonstrate the superiority of DiGS over state-of-the-art baselines. On EndoNeRF, DiGS achieves a 61.75% improvement in LPIPS, indicating stronger perceptual alignment in dynamically occluded scenes. On StereoMIS, DiGS delivers an 7.03% PSNR gain and a 40.79% LPIPS improvement, along with consistently higher SSIM scores confirming superior preservation of structural details.

Conclusion:

The proposed DiGS framework effectively addresses the challenges of dynamic occlusions and motion-induced errors in surgical scene reconstruction, producing more accurate and temporally coherent 3D models. The code is publicly available at https://github.com/IGSResearch/DiGS.