Big data analytics in smart grids: state‐of‐the‐art, challenges, opportunities, and future directions

Abstract

Big data has potential to unlock novel groundbreaking opportunities in power grid that enhances a multitude of technical, social, and economic gains. As power grid technologies evolve in conjunction with measurement and communication technologies, this results in unprecedented amount of heterogeneous big data. In particular, computational complexity, data security, and operational integration of big data into power system planning and operational frameworks are the key challenges to transform the heterogeneous large dataset into actionable outcomes. In this context, suitable big data analytics combined with visualization can lead to better situational awareness and predictive decisions. This paper presents a comprehensive stateof-the-art review of big data analytics and its applications in power grids, and also identifies challenges and opportunities from utility, industry, and research perspectives. The paper analyzes research gaps and presents insights on future research directions to integrate big data analytics into power system planning and operational frameworks. Detailed information for utilities looking to apply big data analytics and insights on how utilities can enhance revenue streams and bring disruptive innovation are discussed. General guidelines for utilities to make the right investment in the adoption of big data analytics by unveiling interdependencies among critical infrastructures and operations are also provided.

Big Data for Energy Management and Energy-Efficient Buildings

“…Buildings data are heterogeneous, often dispersed in non-interoperable silos, with varying resolution, mostly asynchronous and are stored in different formats (raw or processed) at various locations [14]. Individual devices and functional units generate thousands of terabytes data annually and building-related stakeholders must handle millions of terabytes of data [15], which continues to increase over time.…”

A Blockchain-Based Peer-to-Peer Trading Scheme Coupling Energy and Carbon Markets

“…To help the integration of DRESs, 200 million smart meters will be invested in E.U. by 2020 [3], which facilitates increasing number of consumers to produce or store electricity at home through solar panels [4], electric vehicles [5], and batteries [6]. The role of prosumers is formed when consumers actively manage their own electricity generation and consumption [7] relying on smart meters and these technologies.…”

A Novel on Transmission Line Tower Big Data Analysis Model Using Altered K-means and ADQL

“…At the same time, they provide quality power by allowing the power system to check consistently the grid's condition and user patterns as well as for any possible system flaws and providing alternative solutions in some cases. Such huge heterogeneous data combination [16][17][18][19][20] can be quite effective for the power grid when used along with the data obtained from the operational simulations using them. In general, a huge volume (terabytes) of data flows into these modern or smart grids annually [21][22][23][24][25][26][27][28][29] through various types of power network elements (e.g., sensors, smart equipment, etc.)…”

“…In general, a huge volume (terabytes) of data flows into these modern or smart grids annually [21][22][23][24][25][26][27][28][29] through various types of power network elements (e.g., sensors, smart equipment, etc.) that constantly collect the data generated by geographic information systems, SCADA systems, or weather and traffic information systems or from social networks [17][18][19][20]. The development of information and communication technologies based on the advance of hardware and software creates new values across various fields of society in conjunction with the Big Data era [30].…”