<p>Recent studies on simultaneous localization and mapping (SLAM) have tended to employ implicit neural representation, which can improve the efficiency and robustness of SLAM system. However, these methodologies still face challenges, such as tracking failures and low-precision mapping. In this paper, we propose a dense reconstruction visual SLAM system enhanced with closed-loop threading and local map optimization, named TNIE-SLAM. First, we propose a tracking module that utilizes the similarity of ORB feature descriptors and the feature overlap rate of the current frame to model key frames, and then we define a complete and accurate initial map based on full bundle adjustment, which addresses the issue of tracking failure due to undermapped areas. Second, we add the 2D features of the initial map to the spatiotemporal encoding module to obtain the 3D features, enabling real-time prediction and tracking of unknown areas. Finally, considering the low-precision mapping issue arising from the complex geometric shapes of objects within the scene, we propose a local map optimization module that utilizes truncated signed distance fields to model 3D features and update the spatial occupancy of boundary and contour features of objects. We test our method on the synthetic Replica dataset and the real-world ScanNet and TUM RGB-D datasets to compare with some state-of-the-art RGB-D SLAM methods, and the experimental results indicate our method performs well in both tracking and mapping accuracy, surpassing the existing dense neural RGB-D SLAM methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

TNIE-SLAM: Neural Implicit Surface Reconstruction for Tracking-Oriented SLAM

  • Baolin Gan,
  • Congxuan Zhang,
  • Shuaixin Chen,
  • Zhen Chen,
  • Chao He,
  • Ke Lu,
  • Feng Lu

摘要

Recent studies on simultaneous localization and mapping (SLAM) have tended to employ implicit neural representation, which can improve the efficiency and robustness of SLAM system. However, these methodologies still face challenges, such as tracking failures and low-precision mapping. In this paper, we propose a dense reconstruction visual SLAM system enhanced with closed-loop threading and local map optimization, named TNIE-SLAM. First, we propose a tracking module that utilizes the similarity of ORB feature descriptors and the feature overlap rate of the current frame to model key frames, and then we define a complete and accurate initial map based on full bundle adjustment, which addresses the issue of tracking failure due to undermapped areas. Second, we add the 2D features of the initial map to the spatiotemporal encoding module to obtain the 3D features, enabling real-time prediction and tracking of unknown areas. Finally, considering the low-precision mapping issue arising from the complex geometric shapes of objects within the scene, we propose a local map optimization module that utilizes truncated signed distance fields to model 3D features and update the spatial occupancy of boundary and contour features of objects. We test our method on the synthetic Replica dataset and the real-world ScanNet and TUM RGB-D datasets to compare with some state-of-the-art RGB-D SLAM methods, and the experimental results indicate our method performs well in both tracking and mapping accuracy, surpassing the existing dense neural RGB-D SLAM methods.