Optimizing Urban Layouts Using Reinforcement Learning (Q-Learning Agent and Deep Q Network Agents)
摘要
This paper explores the use of reinforcement learning (RL) to optimize urban layouts under the n-minute city model, a planning paradigm that aims to ensure that all essential services are accessible within a short walk distance. The paper presents two RL agents: Qtopia, a Q-learning agent that builds cities from scratch through episodic reward maximization, and city_planner, a Deep Q-Network (DQN) agent capable of classifying and redesigning preexisting city grids. Both agents aim to generate livable, modular and accessible urban environments by balancing proximity, diversity, and spatial compatibility. Both agents were tested and validated on artificial grids and a real-world layout of Rome, integrating natural constraints such as the Tiber River. A new metric for urban efficiency—residential service reachability rate—was introduced to measure how many residences are within the target service radius. The results demonstrate the potential of RL as a scalable tool for intelligent urbanism.