Semantic SLAM is essential for high-level scene understanding in robotics and augmented reality. Recent NeRF-based implicit SLAM methods provide efficient scene representations, but often suffer from insufficient semantic integration, high memory consumption, and suboptimal feature alignment. In this paper, we present COS-SLAM, a novel framework that enhances both spatial and semantic expressiveness through a Tri-Plane representation with coordinate attention. Furthermore, we introduce a lightweight Pixel-To-Line Transformer module for direct extraction of line features from RGB pixels, and propose a depth-guided truncated Gaussian sampling strategy to improve sampling efficiency. Extensive experiments on the Replica and ScanNet benchmarks demonstrate that COS-SLAM achieves geometry and appearance reconstruction comparable to or surpassing state-of-the-art SLAM methods. Notably, for semantic reconstruction, COS-SLAM achieves an mIoU exceeding 93% on the Replica dataset, more than 10% higher than the baseline.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

COS-SLAM: Coordinate Attention Semantic SLAM with Pixel-to-Line Transformer

  • Handong Shen,
  • Lingyu Liang,
  • Beibei Liu,
  • Xiaohao Liu,
  • Xinchao Li,
  • Guoxi Sun,
  • Shuangping Huang

摘要

Semantic SLAM is essential for high-level scene understanding in robotics and augmented reality. Recent NeRF-based implicit SLAM methods provide efficient scene representations, but often suffer from insufficient semantic integration, high memory consumption, and suboptimal feature alignment. In this paper, we present COS-SLAM, a novel framework that enhances both spatial and semantic expressiveness through a Tri-Plane representation with coordinate attention. Furthermore, we introduce a lightweight Pixel-To-Line Transformer module for direct extraction of line features from RGB pixels, and propose a depth-guided truncated Gaussian sampling strategy to improve sampling efficiency. Extensive experiments on the Replica and ScanNet benchmarks demonstrate that COS-SLAM achieves geometry and appearance reconstruction comparable to or surpassing state-of-the-art SLAM methods. Notably, for semantic reconstruction, COS-SLAM achieves an mIoU exceeding 93% on the Replica dataset, more than 10% higher than the baseline.