<p>3D instance segmentation is essential in applications such as autonomous driving, augmented reality, and robotics, where accurate identification of individual objects in complex point cloud data is required. Existing methods typically rely on feature learning in a single spatial domain and often fail in cases involving overlapping objects and sparse point distributions. To solve these problems, we propose 3D-SDIS, a multi-domain 3D instance segmentation network. It includes an Fast Fourier Transform (FFT) Spatial Fusion Encoder (FSF Encoder) that transforms spatial features into the frequency domain. This process reduces interference from redundant points and improves boundary localization. We also introduce an Offset Dual-Sphere Sampling Module (ODSS), which performs multi-view feature sampling based on both the original and offset sphere centers. It increases the receptive field and captures more geometric information. Experimental results on the ScanNetV2 (mAP 62.9) and S3DIS (mAP 61.0) datasets demonstrate the superiority of 3D-SDIS over state-of-the-art methods, especially for handling overlapping instances and large planar structures. The source code and trained models are available at http:// github.com/cbbbbg/3D-SDIS.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

3D-SDIS: enhanced 3D instance segmentation through frequency fusion and dual-sphere sampling

  • BingGe Cong,
  • XiaoHang Wang,
  • Xu Zhao,
  • TianShui Zhu,
  • NingNing Zhang,
  • KaiHang Chen

摘要

3D instance segmentation is essential in applications such as autonomous driving, augmented reality, and robotics, where accurate identification of individual objects in complex point cloud data is required. Existing methods typically rely on feature learning in a single spatial domain and often fail in cases involving overlapping objects and sparse point distributions. To solve these problems, we propose 3D-SDIS, a multi-domain 3D instance segmentation network. It includes an Fast Fourier Transform (FFT) Spatial Fusion Encoder (FSF Encoder) that transforms spatial features into the frequency domain. This process reduces interference from redundant points and improves boundary localization. We also introduce an Offset Dual-Sphere Sampling Module (ODSS), which performs multi-view feature sampling based on both the original and offset sphere centers. It increases the receptive field and captures more geometric information. Experimental results on the ScanNetV2 (mAP 62.9) and S3DIS (mAP 61.0) datasets demonstrate the superiority of 3D-SDIS over state-of-the-art methods, especially for handling overlapping instances and large planar structures. The source code and trained models are available at http:// github.com/cbbbbg/3D-SDIS.