To enhance the adaptability and safety of autonomous vehicles in complex environments, accurate environmental understanding and prediction are paramount, motivating research into world models. Point cloud-based prediction world models have garnered significant attention due to their superior three-dimensional environment representation capabilities. However, in unstructured off-road scenarios, existing methods still face challenges in achieving accurate predictions of terrain edge features and ensuring the accuracy of continuous state prediction. To solve these problems, we propose the self-supervised point cloud prediction world model WildPCP-Mamba. This model, based on the Mamba architecture, constructs a bidirectional spatio-temporal modeling network capable of effectively learning spatiotemporal features from point clouds. Additionally, the integrated Terrain Edge Feature Enhancement Module (TEEM) employs attention mechanisms and multi-level feature fusion to significantly improve edge feature prediction performance. Experiment results on the Rellis-3D dataset demonstrate WildPCP-Mamba’s superior point cloud prediction capabilities, with an average Chamfer distance reduction of 43%. The model achieves precise predictions up to 5 frames while maintaining a Chamfer distance below 0.2.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

WildPCP-Mamba: A Self-supervised Point Cloud Prediction Model For Off-Road Scenarios

  • Shunxin Huang,
  • Yiming Nie,
  • Liangdong Zhang,
  • Baobao Zhang,
  • Kai Fu,
  • Liang Xiao

摘要

To enhance the adaptability and safety of autonomous vehicles in complex environments, accurate environmental understanding and prediction are paramount, motivating research into world models. Point cloud-based prediction world models have garnered significant attention due to their superior three-dimensional environment representation capabilities. However, in unstructured off-road scenarios, existing methods still face challenges in achieving accurate predictions of terrain edge features and ensuring the accuracy of continuous state prediction. To solve these problems, we propose the self-supervised point cloud prediction world model WildPCP-Mamba. This model, based on the Mamba architecture, constructs a bidirectional spatio-temporal modeling network capable of effectively learning spatiotemporal features from point clouds. Additionally, the integrated Terrain Edge Feature Enhancement Module (TEEM) employs attention mechanisms and multi-level feature fusion to significantly improve edge feature prediction performance. Experiment results on the Rellis-3D dataset demonstrate WildPCP-Mamba’s superior point cloud prediction capabilities, with an average Chamfer distance reduction of 43%. The model achieves precise predictions up to 5 frames while maintaining a Chamfer distance below 0.2.