Scholarlink

<p>This paper introduces a traffic signal control system using deep reinforcement learning to solve the congestion problems at signalized intersections under dynamic traffic conditions. The proposed framework is simulated with the help of MATLAB-SUMO co-simulation framework, the traffic signal control is modeled as a Markov Decision Process (MDP). State space includes traffic density, the queue length, vehicles waiting time, and the actual signal phase whereas the action space comprises of the possible selections of the signal phase. A Deep Q-Network (DQN) is utilized to estimate the optimal state-action value function so that green times can be dynamically allocated based on the changing traffic demand. Multi-objective reward functionality is based on the combined minimization of vehicle delay, queue length, and waiting time and maximization of traffic throughput. Experience replay and target network updates are used to stabilize the learning process. Simulation experiments are conducted in low, medium, and high traffic demand conditions to compare the work of the suggested framework with fixed-time control, actuated control, and classical tabular Q-learning methods. Experimental results demonstrate that the proposed framework reduces average delay by up to 33.9%, decreases queue length by 47.1%, and increases throughput by 25.5% compared to fixed-time control under high-demand conditions. Finally, scalability studies involving networks of up to 16 isolated signalized intersections were conducted to assess computational feasibility and robustness even when the size of the network grows. Comprehensively, the results prove the usefulness of deep reinforcement learning in the creation of intelligent and adaptive traffic signal control services in the city.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Deep reinforcement learning-based adaptive traffic signal control in urban networks

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年8月2日

查看全文
  • Manisha Aeri,
  • Kamlesh Chandra Purohit,
  • Lata Nautiyal,
  • Baraa Zieni

摘要

This paper introduces a traffic signal control system using deep reinforcement learning to solve the congestion problems at signalized intersections under dynamic traffic conditions. The proposed framework is simulated with the help of MATLAB-SUMO co-simulation framework, the traffic signal control is modeled as a Markov Decision Process (MDP). State space includes traffic density, the queue length, vehicles waiting time, and the actual signal phase whereas the action space comprises of the possible selections of the signal phase. A Deep Q-Network (DQN) is utilized to estimate the optimal state-action value function so that green times can be dynamically allocated based on the changing traffic demand. Multi-objective reward functionality is based on the combined minimization of vehicle delay, queue length, and waiting time and maximization of traffic throughput. Experience replay and target network updates are used to stabilize the learning process. Simulation experiments are conducted in low, medium, and high traffic demand conditions to compare the work of the suggested framework with fixed-time control, actuated control, and classical tabular Q-learning methods. Experimental results demonstrate that the proposed framework reduces average delay by up to 33.9%, decreases queue length by 47.1%, and increases throughput by 25.5% compared to fixed-time control under high-demand conditions. Finally, scalability studies involving networks of up to 16 isolated signalized intersections were conducted to assess computational feasibility and robustness even when the size of the network grows. Comprehensively, the results prove the usefulness of deep reinforcement learning in the creation of intelligent and adaptive traffic signal control services in the city.