Decentralized Reinforcement Learning Approach for Microgrid Energy Management in Stochastic Environment

Abstract

Microgrids are considered to be smart power grids that can integrate Distributed Energy Resources (DERs) in the main grid cleanly and reliably. Due to the random and unpredictable nature of Renewable Energy Sources (RESs) and electricity demand, designing a control system for microgrid energy management is a complex task. In addition, the policies of microgrid agents are changing over time to improve their expected profits. Therefore, the problem is stochastic and the policies of the agents are not stationary and deterministic. This paper proposes a fully decentralized multiagent Energy Management System (EMS) for microgrids using the reinforcement learning and stochastic game. The microgrid agents, comprising customers, and DERs are considered as intelligent and autonomous decision makers. The proposed method solves a distributed optimization problem for each self-interested decision maker. Interactions between the decision makers and the environment during the learning phase lead the system to converge to the optimal equilibrium point in which the benefits of all the agents are maximized. Simulation studies using a real dataset demonstrate the effectiveness of the proposed method for the hourly energy management of microgrids.

Using Stochastic Dual Dynamic Programming to Solve the Multi-Stage Energy Management Problem in Microgrids

“…Here, 𝜑 , 𝑥 represents the expected value of 𝛼 𝑥 given all possible uncertainty realizations at stage 𝑇 and scenario 𝑠. A piecewise linear approximation, known as a polyhedral approximation, is constructed as shown in (13):…”

“…This frequent updating of decisions is crucial to managing the rapid changes in generation and demand. Effective EMS are crucial for the success of microgrids, ensuring real-time balance and system stability [13]. Poor energy management can lead to increased operational costs and potential instability in the main grid [14].…”

Single-Phase Microgrid Power Quality Enhancement Strategies: A Comprehensive Review

“…Single-phase microgrids (1Ø-µGs) have recently received significant consideration as an alternative solution to provide a reliable and sustainable power supply to remote and isolated communities [1][2][3][4][5][6]. These µGs are typically designed to operate autonomously from the main power grid, making them an ideal solution for areas with limited access to conventional grid infrastructure.…”