Scholarlink

<p>To enhance segmentation in 3D reconstruction, especially for dense textures, blurred edges, and small structures, this study proposes MF-ESG, a non-invasive method for multi-view image acquisition and 3D segmentation. It introduces the SAGa framework, which combines 3DGS with SAM’s zero-shot capabilities to produce low-dimensional masks from 2D images, guiding multimodal 3D feature learning. This improves adaptability across various stone relic scenes. The edge-sensitive MLLS module, incorporating multi-scale large-kernel attention and dynamic receptive fields, enhances edge segmentation in complex environments. On SPIn-NeRF, NVOS, and custom datasets, the method achieves average mIoU scores of 94.1%, 94.3%, and 95.75%, surpassing SAGa by 0.7%, 1.7%, and 1.23%, respectively. It also significantly reduces edge defects and central voids in reconstruction.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

3D segmentation method for stone cultural relics utilizing multi-modal feature enhancement based on SAM

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年9月23日

查看全文
  • Yuan Gong,
  • Tao Song,
  • Jianxu Wang,
  • Zheng Zou,
  • Yulin Wang,
  • Runrun Liu,
  • Guoshi Huang

摘要

To enhance segmentation in 3D reconstruction, especially for dense textures, blurred edges, and small structures, this study proposes MF-ESG, a non-invasive method for multi-view image acquisition and 3D segmentation. It introduces the SAGa framework, which combines 3DGS with SAM’s zero-shot capabilities to produce low-dimensional masks from 2D images, guiding multimodal 3D feature learning. This improves adaptability across various stone relic scenes. The edge-sensitive MLLS module, incorporating multi-scale large-kernel attention and dynamic receptive fields, enhances edge segmentation in complex environments. On SPIn-NeRF, NVOS, and custom datasets, the method achieves average mIoU scores of 94.1%, 94.3%, and 95.75%, surpassing SAGa by 0.7%, 1.7%, and 1.23%, respectively. It also significantly reduces edge defects and central voids in reconstruction.