<p>Visual-inertial odometry (VIO) systems often struggle in visually challenging environments due to two common issues: ensuring reliable feature tracking and managing uncertainties that arise from integrating diverse observations. This paper presents a robust multi-camera VIO system that addresses these limitations through two key innovations. First, we develop a learning-based feature extraction module specifically designed for multi-camera configurations, which generates stable descriptors to validate optical flow correspondences and retain only high-quality features while reducing computational overhead. Second, we introduce an adaptive weighting scheme in the backend that employs weighting techniques across multiple cameras to quantify tracking uncertainties and assign appropriate weights to different viewpoints based on their reliability. The system seamlessly integrates an arbitrary number of cameras to enhance robustness in challenging scenarios. Extensive evaluation on datasets featuring visually degraded conditions demonstrates the effectiveness of our approach, achieving up to 90% reduction in ATE compared to state-of-the-art VIO methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Flexible Multi-camera Visual-inertial Architecture for Robust State Estimation in Challenging Scenarios

  • Duy Quoc Tran,
  • Danh Thanh Phan,
  • Gon-Woo Kim

摘要

Visual-inertial odometry (VIO) systems often struggle in visually challenging environments due to two common issues: ensuring reliable feature tracking and managing uncertainties that arise from integrating diverse observations. This paper presents a robust multi-camera VIO system that addresses these limitations through two key innovations. First, we develop a learning-based feature extraction module specifically designed for multi-camera configurations, which generates stable descriptors to validate optical flow correspondences and retain only high-quality features while reducing computational overhead. Second, we introduce an adaptive weighting scheme in the backend that employs weighting techniques across multiple cameras to quantify tracking uncertainties and assign appropriate weights to different viewpoints based on their reliability. The system seamlessly integrates an arbitrary number of cameras to enhance robustness in challenging scenarios. Extensive evaluation on datasets featuring visually degraded conditions demonstrates the effectiveness of our approach, achieving up to 90% reduction in ATE compared to state-of-the-art VIO methods.