False Data Injection Attacks on Reinforcement Learning-Based Charging Coordination in Smart Grids and a Countermeasure

Abstract

Reinforcement learning (RL) is proven effective in optimizing home battery charging coordination within smart grids. However, its vulnerability to adversarial behavior poses a significant challenge to the security and fairness of the charging process. In this study, we, first, craft five stealthy false data injection (FDI) attacks that under-report the state-of-charge (SoC) values to deceive the RL agent into prioritizing their charging requests, and then, we investigate the impact of these attacks on the charging coordination system. Our evaluations demonstrate that attackers can increase their chances of charging compared to honest consumers. As a result, honest consumers experience reduced charging levels for their batteries, leading to a degradation in the system’s performance in terms of fairness, consumer satisfaction, and overall reward. These negative effects become more severe as the amount of power allocated for charging decreases and as the number of attackers in the system increases. Since the total available power for charging is limited, some honest consumers with genuinely low SoC values are not selected, creating a significant disparity in battery charging levels between honest and malicious consumers. To counter this serious threat, we develop a deep learning-based FDI attack detector and evaluated it using a real-world dataset. Our experiments show that our detector can identify malicious consumers with high accuracy and low false alarm rates, effectively protecting the RL-based charging coordination system from FDI attacks and mitigating the negative impacts of these attacks.