Adaptive Load Frequency Control and Optimization Based on TD3 Algorithm and Linear Active Disturbance Rejection Control

This paper presents the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm optimized Linear Active Disturbance Rejection Control (LADRC) approach to tackle the problem of frequency deviation resulting from load disturbance and Renewable Energy Sources (RESs) in interconnected power systems. The LADRC approach employs a Linear Extended State Observer (LESO) to estimate the disturbance information in each area and utilizes a Proportional-Derivative (PD) controller to eliminate the disturbance. Simultaneously, the TD3 algorithm is trained in to acquire the adaptive controller parameters. In order to improve the convergence of the TD3 algorithm, a Lyapunov-reward shaping function is adopted. Finally, the proposed method is applied to two-area interconnected power system, comprising thermal, hydro, and gas power plants in each area, as well as RESs such as a noise-based wind turbine and photovoltaic (PV) system. The simulation results indicate that the proposed method is a highly effective approach for load frequency control.