Multi-agent deep reinforcement learning for coordination scheduling of water-intake pumping stations
摘要
Water-intake pumping stations (WIPSs) are critical to waterworks energy consumption and operational costs. This paper addresses the optimal scheduling of multiple WIPS pumps, aiming to minimize total energy consumption while satisfying reservoir level, main pipe pressure difference, and pump switching frequency constraints. The problem is complicated by implicit system dynamics, temporally coupled constraints, and future water demand uncertainties. To tackle this, we reformulate it as a cooperative multi-agent Markov decision process (CM-MDP) with heterogeneous agents, and propose an energy-efficient scheduling algorithm by optimizing the integration of a surrogate model-assisted multi-agent attention-based deep reinforcement learning (SM-MAADRL) framework. Real-world simulations show the algorithm is highly robust to surrogate model uncertainties, reducing energy consumption by 2.04% compared to optimized Greedy strategies and 12.5% compared to standard MADDPG.