The increasing penetration of Electric Vehicles (EVs) and renewable energy sources is placing significant stress on existing power grid infrastructure. This work investigates the application of vehicle-to-grid (V2G)-enabled smart charging in workplace environments from the perspective of EV aggregators, using real-world charging data from Dutch business parking lots. To address the limitations of conventional deep Reinforcement Learning (RL) methods in enforcing operational constraints, we propose a Safe RL method using the Constrained Variational Policy Optimization (CVPO) algorithm, specifically designed to reduce constraint violations and enhance reliability. Empirical results show that CVPO outperforms classic RL baselines and rule-based policies, closely approximating the performance of an optimal offline benchmark while exhibiting strong generalization to unseen scenarios.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Safe Reinforcement Learning for V2G-Enabled Electric Vehicle Aggregators

  • Ruben Eland,
  • Stavros Orfanoudakis,
  • Pedro P. Vergara

摘要

The increasing penetration of Electric Vehicles (EVs) and renewable energy sources is placing significant stress on existing power grid infrastructure. This work investigates the application of vehicle-to-grid (V2G)-enabled smart charging in workplace environments from the perspective of EV aggregators, using real-world charging data from Dutch business parking lots. To address the limitations of conventional deep Reinforcement Learning (RL) methods in enforcing operational constraints, we propose a Safe RL method using the Constrained Variational Policy Optimization (CVPO) algorithm, specifically designed to reduce constraint violations and enhance reliability. Empirical results show that CVPO outperforms classic RL baselines and rule-based policies, closely approximating the performance of an optimal offline benchmark while exhibiting strong generalization to unseen scenarios.