Robust Control of Water Distribution Networks Under Drought Stress: A Multi-Agent Curriculum Learning Approach
摘要
Multi-Agent Reinforcement Learning (MARL) for water distribution networks often exhibits policy brittleness when exposed to out-of-distribution stressors. This study introduces a Multi-Phase Curriculum Learning (MPCL) framework designed to enhance resilience under stochastic drought conditions. Leveraging real-world hydrological data from Seattle, WA, agents are transitioned through staged training phases that progressively expose them to increasing environmental stress. Statistical validation across five independent seeds (n = 5) demonstrates that MPCL achieves a 95% reduction in violation variance (σ: 39.3 → 1.8) compared to standard MAPPO baselines, substantially improving cross-seed operational stability. Furthermore, the framework reduces system oversupply by 52.3% during severe drought while suppressing oscillatory depletion dynamics, representing a significant gain in hydraulic efficiency. Behavioral analysis identifies an emergent coordination mechanism, termed “Predictive Throttling,” wherein agents utilize latent communication to coordinate resource preservation as hydraulic stress intensifies. Run-length analysis further reveals suppression of oscillatory collapse-recovery behavior and convergence toward a temporally stable low-storage operating regime. These findings demonstrate that curriculum-staged training induces stable degradation dynamics and suppresses oscillatory collapse–recovery behavior, supporting the deployment of robust, coordinated AI in critical municipal infrastructure systems.