Scholarlink

<p>This study provides a thorough investigation into autonomous exploration within unknown environments, with a focus on minimizing exploration time and so fuel consumption. This research utilizes a 2D simulation environment to collect training data efficiently, facilitating the evaluation of the proposed methods’ efficiency, adaptability, and generalizability through various experiments. Single-robot autonomous exploration policies using advanced Deep Reinforcement Learning (DRL) algorithms are developed. The main novelty of this paper is the development of risk-sensitive policies, in contrast to traditional risk-neutral approaches in DRL, to enhance exploration efficiency. Additionally, this research presents the development of an adaptive autonomous exploration policy that dynamically adjusts the Conditional Value-at-Risk (CVaR) based on the exploration percentage. The results demonstrate a significant improvement in autonomous exploration efficiency compared to well-known traditional RL and classical single-robot exploration policies, validating the effectiveness of the suggested novel autonomous exploration strategies.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Risk-Sensitive Autonomous Exploration of Unknown Environments: A Deep Reinforcement Learning Perspective

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年3月12日

查看全文
  • Mohammad Hossein Sarfi,
  • Mahdis Bisheban

摘要

This study provides a thorough investigation into autonomous exploration within unknown environments, with a focus on minimizing exploration time and so fuel consumption. This research utilizes a 2D simulation environment to collect training data efficiently, facilitating the evaluation of the proposed methods’ efficiency, adaptability, and generalizability through various experiments. Single-robot autonomous exploration policies using advanced Deep Reinforcement Learning (DRL) algorithms are developed. The main novelty of this paper is the development of risk-sensitive policies, in contrast to traditional risk-neutral approaches in DRL, to enhance exploration efficiency. Additionally, this research presents the development of an adaptive autonomous exploration policy that dynamically adjusts the Conditional Value-at-Risk (CVaR) based on the exploration percentage. The results demonstrate a significant improvement in autonomous exploration efficiency compared to well-known traditional RL and classical single-robot exploration policies, validating the effectiveness of the suggested novel autonomous exploration strategies.