A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management

Abstract

This paper proposes a novel framework for home energy management (HEM) based on reinforcement learning in achieving efficient home-based demand response (DR). The concerned hour-ahead energy consumption scheduling problem is duly formulated as a finite Markov decision process (FMDP) with discrete time steps. To tackle this problem, a data-driven method based on neural network (NN) and Q-learning algorithm is developed, which achieves superior performance on cost-effective schedules for HEM system. Specifically, real data of electricity price and solar photovoltaic (PV) generation are timely processed for uncertainty prediction by extreme learning machine (ELM) in the rolling time windows. The scheduling decisions of the household appliances and electric vehicles (EVs) can be subsequently obtained through the newly developed framework, of which the objective is dual, i.e. to minimize the electricity bill as well as the DR induced dissatisfaction. Simulations are performed on a residential house level with multiple home appliances, an EV and several PV panels. The test results demonstrate the effectiveness of the proposed data-driven based HEM framework.

A Review of Technical Standards for Smart Cities

“…Energy and environment: Sustainable growth is created by technology and cities make better use of resources from electronic sensors that monitor leakages, as well as gamification and behavioral economics to support citizens to conduct considerate decisions on resource utilization [29]. Renewable energy including solar and wind will be important sources of energy generation [30][31][32]. Data analytics will be used to enhance energy and power system operation [33]; 2.…”

Robust energy hub optimization with cross‐vector demand response

“…Equation 17ensures that charging and discharging do not occur simultaneously. The remaining energy with its limits is shown in (18) and (19).…”

“…Demand response (DR) is a viable solution for network operators to stimulate energy customers to shift flexible load. 18 Customers are willing to alter their energy consumption patterns in response to energy price signals. DR in EHS has been investigated in existing papers.…”

Photovoltaic Output Power Estimation and Baseline Prediction Approach for a Residential Distribution Network with Behind-the-Meter Systems

“…The installed power capacity of renewable energy generation grew more than 200 GW, which is mostly PV generation in 2019 [4,5]. However, because of the intermittency and uncertainty of PV, the high penetration of PV could bring great challenges to the power grid, such as power distribution system planning and operation [6][7][8][9], load demand forecasting [10][11][12], hybrid energy system configuration [13,14], and PV power forecasting [15,16].…”