Big Data Management in Smart Grids: Technologies and Challenges

Abstract

Smart grids are re-engineering the electricity transmission and distribution system throughout the world. It is an amalgam of increased digital information with the electrical power grids. Managing the data generated from the grid efficiently is the key to successful knowledge extraction from the smart grid big data. Most of the scientific advancements are becoming data-driven and becoming an interesting area of research for data scientists. It is challenging the world computationally enough to develop new storage methods and data processing technologies. Managing big data involves data cleaning, integration of varied data sources, and decision-making applications. This paper focuses on the study of big data management and proposes a management process to help manage the data in the grid. Data management tools and techniques have been leveraged in understanding the sources and data types in the grid. The paper emphasizes the limitations of the existing solutions inclined towards applications of the smart grid big data.

A Review on Optimal Energy Management of Multimicrogrid System Considering Uncertainties

“…Therefore, the emerging management solution should be efficient and low-cost for an economically viable smart grid. The main research directions of current MMG energy management and operation control in different cooperative approaches can be summarized as the following three aspects:1) energy transaction strategy [76][77][78][79][80]; 2) information interaction strategy [81][82][83][84]; 3) artificial intelligence technology in MMG [88][89][90][91][92][93][94]. Table 3 summarized and compared the different solution methods and optimization objectives of energy management and operation control of MMG under different cooperative approaches.…”

“…With the rapid development of artificial intelligence technology, deep learning, enhanced learning, and other theoretical methods showed great advantages in data analysis, prediction, classification, and other aspects, especially in the processing of massive data [88][89]. At present, many related technologies have been applied in MMG operation, energy management and other aspects [90][91][92].…”

An IoT-Based Services Infrastructure for Utility-Scale Distributed Solar Farms

“…However, conventional databases such as MongoDB were not designed to handle large volumes of real-time data. High-volume, high-velocity data storage and management is best handled by Big Data platforms such as Hadoop [41], which implement concepts such as parallel processing, data partitioning, and map-reduce in order to accelerate data storage and retrieval [64].…”

Research on intelligent construction data resource catalogue based on power grid business

“…In 2019, Lwin, aiming at the application of big data analysis technology in disaster management, constructed a set of spatial analysis tools of geographical visualization through data analysis and Internet of Things technology, which are used to improve spatial thinking and planning process in disaster management, so as to reduce the loss of life and property 13 . In 2021, Zainab proposed A method for centralized management of smart grid data in view of data management problems in smart grid, and provided auxiliary decision-making role for grid operation and construction through data management method 14 . In 2021, Dong Wang, a science and technology project management data model is put forward, which pertaining to the project units, themes, and between inner link.…”