<p>Deep Reinforcement Learning has shown immense potential in autonomous driving decision-making; however, its application in safety–critical scenarios such as highways still faces significant challenges in data efficiency and safety performance. To address this, this paper proposes an LLM-guided Safety-Aware DQN (LSA-DQN) framework. This framework first utilizes a multi-head attention network to enhance the comprehension of complex traffic scenarios. Building on this, we design a method combining physics-based pre-screening and Large Language Model (LLM) arbitration to accurately classify experience data. Furthermore, we devise a hybrid safety regularization method that integrates Conservative Q-Learning with a Margin-based Contrastive Penalization (MCP) to learn explicit safety boundaries. Experimental results demonstrate that, compared to baseline algorithms, LSA-DQN reduces the collision rate to 0.9% while maintaining high traffic efficiency, proving its high robustness and reliability in complex and dynamic highway environments.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

LLM-guided deep reinforcement learning with contrastive safety regularization for autonomous driving

  • Haochen Ren,
  • Yuelin Xing

摘要

Deep Reinforcement Learning has shown immense potential in autonomous driving decision-making; however, its application in safety–critical scenarios such as highways still faces significant challenges in data efficiency and safety performance. To address this, this paper proposes an LLM-guided Safety-Aware DQN (LSA-DQN) framework. This framework first utilizes a multi-head attention network to enhance the comprehension of complex traffic scenarios. Building on this, we design a method combining physics-based pre-screening and Large Language Model (LLM) arbitration to accurately classify experience data. Furthermore, we devise a hybrid safety regularization method that integrates Conservative Q-Learning with a Margin-based Contrastive Penalization (MCP) to learn explicit safety boundaries. Experimental results demonstrate that, compared to baseline algorithms, LSA-DQN reduces the collision rate to 0.9% while maintaining high traffic efficiency, proving its high robustness and reliability in complex and dynamic highway environments.