Scholarlink

<p>Increased traffic congestion, limited delivery windows, vehicles’ diverse fleets, and dynamic environments are all contributing factors to the inefficiency of urban freight systems. Due to the inability of traditional routing techniques to adjust in real-time to partially visible multi-constrained conditions, delivery delays, fuel consumption, and operating costs all increased. This research proposes a constraint-aware projected policy learning-reinforcement learning (CAPPL-RL) framework to optimize urban freight delivery routes while enforcing real-world constraints, including traffic congestion, delivery time windows, and vehicle capacity. The routing problem is formulated as a partially observable Markov decision process, with autonomous vehicles as agents navigating stochastic urban traffic networks. Using the UFVOD dataset, CAPPL-RL integrates Q-learning with ε-greedy exploration and projection-based constrained policy optimization (PCPO) to enable adaptive, constraint-aware routing. Simulation results demonstrate that CAPPL-RL outperforms PCPO-RL, reducing average delivery time from 65.3 to 52.1&#xa0;min (20.2%), fuel consumption from 0.12 to 0.093&#xa0;L/km (22.5%), and constraint violations in time windows from 12 to 3 (75%) while achieving 100% compliance with vehicle capacity limits. These results validate CAPPL-RL as a robust, scalable, and adaptive framework for dynamic urban freight logistics.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Optimization of urban freight intelligent route based on reinforcement learning

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年4月10日

查看全文
  • Guizhe Xin,
  • Yuqing Tang,
  • Hongzhen Gao,
  • Na Li

摘要

Increased traffic congestion, limited delivery windows, vehicles’ diverse fleets, and dynamic environments are all contributing factors to the inefficiency of urban freight systems. Due to the inability of traditional routing techniques to adjust in real-time to partially visible multi-constrained conditions, delivery delays, fuel consumption, and operating costs all increased. This research proposes a constraint-aware projected policy learning-reinforcement learning (CAPPL-RL) framework to optimize urban freight delivery routes while enforcing real-world constraints, including traffic congestion, delivery time windows, and vehicle capacity. The routing problem is formulated as a partially observable Markov decision process, with autonomous vehicles as agents navigating stochastic urban traffic networks. Using the UFVOD dataset, CAPPL-RL integrates Q-learning with ε-greedy exploration and projection-based constrained policy optimization (PCPO) to enable adaptive, constraint-aware routing. Simulation results demonstrate that CAPPL-RL outperforms PCPO-RL, reducing average delivery time from 65.3 to 52.1 min (20.2%), fuel consumption from 0.12 to 0.093 L/km (22.5%), and constraint violations in time windows from 12 to 3 (75%) while achieving 100% compliance with vehicle capacity limits. These results validate CAPPL-RL as a robust, scalable, and adaptive framework for dynamic urban freight logistics.