Prior research has demonstrated the effectiveness of end-to-end reinforcement learning for PointGoal navigation tasks within indoor environments. Given 2.5 billion frames of experience, a navigation policy can be trained to achieve a success rate of 0.94 when deployed in unseen environments. However, a limitation of this approach is its reliance on perfect localisation, which is unrealistic for real-world deployment scenarios where localisation must be estimated, inevitably introducing errors. In this paper, we present a study on the effectiveness of integrating a traditional vision-based SLAM algorithm with a reinforcement learning-based PointGoal navigation policy. Through our experimentation, we demonstrate how fine-tuning a pre-trained navigation policy on realistic localisation estimates can increase the success rate by 14% (0.71 \(\rightarrow \) 0.85) and SPL by 15% (0.66 \(\rightarrow \) 0.81) when compared to deploying policies in a zero-shot manner.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Localisation-Aware Fine-Tuning for Realistic PointGoal Navigation

  • Fraser McGhan,
  • Ze Ji,
  • Raphael Grech

摘要

Prior research has demonstrated the effectiveness of end-to-end reinforcement learning for PointGoal navigation tasks within indoor environments. Given 2.5 billion frames of experience, a navigation policy can be trained to achieve a success rate of 0.94 when deployed in unseen environments. However, a limitation of this approach is its reliance on perfect localisation, which is unrealistic for real-world deployment scenarios where localisation must be estimated, inevitably introducing errors. In this paper, we present a study on the effectiveness of integrating a traditional vision-based SLAM algorithm with a reinforcement learning-based PointGoal navigation policy. Through our experimentation, we demonstrate how fine-tuning a pre-trained navigation policy on realistic localisation estimates can increase the success rate by 14% (0.71 \(\rightarrow \) 0.85) and SPL by 15% (0.66 \(\rightarrow \) 0.81) when compared to deploying policies in a zero-shot manner.