Efficient Learning of Voltage Control Strategies via Model-based Deep Reinforcement Learning

Hossain, Ramij R.; Yin, Tianzhixi; Du, Youwei; Huang, Renke; Tan, Jie; Yu, Wenhao; Liu, Yuan; Huang, Qiu-Hua

doi:10.48550/arxiv.2212.02715

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another study [32] proposes a hybrid algorithm that initially trains the agent using a simulation model, then incorporates some real-life trials after obtaining an approximation to achieve near-optimal performance. Similarly, other studies [33,34] integrate prior knowledge of the environment to minimize the impact of model inaccuracy. In yet another study [35], an online tuning algorithm is proposed to ameliorate the negative impact of model inaccuracy during the training process.…”

Section: Introductionmentioning

confidence: 99%

Deep reinforcement learning based voltage control revisited

Nematshahi,

Shi,

Wang

et al. 2023

IET Generation Trans & Dist

View full text Add to dashboard Cite

Deep Reinforcement Learning (DRL) has shown promise for voltage control in power systems due to its speed and model‐free nature. However, learning optimal control policies through trial and error on a real grid is infeasible due to the mission‐critical nature of power systems. Instead, DRL agents are typically trained on a simulator, which may not accurately represent the real grid. This discrepancy can lead to suboptimal control policies and raises concerns for power system operators. In this paper, we revisit the problem of RL‐based voltage control and investigate how model inaccuracies affect the performance of the DRL agent. Extensive numerical experiments are conducted to quantify the impact of model inaccuracies on learning outcomes. Specifically, techniques that enable the DRL agent are focused on learning robust policies that can still perform well in the presence of model errors. Furthermore, the impact of the agent's decisions on the overall system loss are analyzed to provide additional insight into the control problem. This work aims to address the concerns of power system operators and make DRL‐based voltage control more practical and reliable.

show abstract