Scholarlink

<p>This paper proposes a novel model-free control of an islanded microgrid (MG) using value- and policy-based deep reinforcement learning (DRL) for secondary frequency regulation, considering the nonlinear behavior of renewable energy sources (RES), load variations, and limitations of model-based techniques. The proposed DRL incorporates both value-based deep-Q learning (DQN) and policy-based proximal policy optimization (PPO) agents. The employed MG test-bench environment includes 300 small-capacity distributed energy resources. The proposed model-free control is compared with the existing distributed model predictive controller (MPC), adaptive linear quadratic regulator (LQR), and proportional–integral–derivative with a first-order filter (PIDF). The results depict a 91.9% and 61.6% reduction in average secondary frequency deviation, obtained using value- and policy-based proposed DRL methodology as compared to model-based optimal control techniques. Additionally, the proposed technique optimizes the operational cost of the system by merging observations of both agents. Also, the system stability is validated by comparing the integral square error (ISE) with prior model-based techniques.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Deep Reinforcement Learning-Based Model-Free Secondary Frequency Control of Widespread Islanded Microgrid with Stability Constraints

  • 期刊论文

  • 发表日期：

    2025年10月15日

查看全文
  • Ramisha Qasim Awan,
  • Kamran Zeb,
  • Rameez Hayat,
  • Ahmed Rasheed,
  • Waqar Uddin,
  • Muhammad Khalid

摘要

This paper proposes a novel model-free control of an islanded microgrid (MG) using value- and policy-based deep reinforcement learning (DRL) for secondary frequency regulation, considering the nonlinear behavior of renewable energy sources (RES), load variations, and limitations of model-based techniques. The proposed DRL incorporates both value-based deep-Q learning (DQN) and policy-based proximal policy optimization (PPO) agents. The employed MG test-bench environment includes 300 small-capacity distributed energy resources. The proposed model-free control is compared with the existing distributed model predictive controller (MPC), adaptive linear quadratic regulator (LQR), and proportional–integral–derivative with a first-order filter (PIDF). The results depict a 91.9% and 61.6% reduction in average secondary frequency deviation, obtained using value- and policy-based proposed DRL methodology as compared to model-based optimal control techniques. Additionally, the proposed technique optimizes the operational cost of the system by merging observations of both agents. Also, the system stability is validated by comparing the integral square error (ISE) with prior model-based techniques.