Big Data Integration of Smart Grid Consumption Data

Abstract

In the energy field, in the context of the constant and significant growth of smart devices and smart meters usage, there are constant streams of data that should be properly captured, analyzed and taken advantage of. The article focuses on the presentation of the integration process of a data stream received from smart meters, using Spark, as part of the research conducted within the SMARTRADE project for developing an informatics system prototype for forecasting, analysis and decision models for electricity suppliers in order to estimate electricity consumption and production efficiently.

Advanced Data Analysis of Smart Grid Consumption Data

“…For a better understanding of the context, in the paper [11] we have presented the architecture of the SMARTRADE prototype. Then, through the studies in paper [1] we highlighted the process of streaming data integration in an Oracle database using Spark. However, given the large volume of data that is generated and need to be stored and processed, we have also considered a solution based on non-relational databases.…”

“…This paper presents some research conducted within the SMARTRADE (Intelligent System for Trading on the Wholesale Electricity Market) research project, which has as objective the design and development of an informatics system prototype for forecasting, analysis and decision models for electricity suppliers in order to estimate consumption and production in an appropriate way for efficient transactions in the wholesale energy market. A series of our own studies, like [1] or [2], as well as some established ones, such as [3], [4] or [5], offer detailed definitions of the smart grid concept. Thus, if the term grid refers to the electrical network, the term smart refers to digital technologies which ensure the interaction of customers with the electrical devices.…”

“…These will be achieved by using new technologies, products and services, in order to create an integrated environment for the actions of all users connected to it. While [1] and [2] focus on data integration, exemplifying the process of integrating streaming data with static data that is received from smart meters, this paper focuses on data presentation, exemplifying some interesting aspects regarding NoSQL integration with Business Intelligence solutions.…”