Distributed data management in energy sector using Hadoop

Abstract

Eefficient use of energy is the need of an hour.Improving energy efficiency requires understanding of the usage patterns and practices. The outage is a wakeup call to modernize the infrastructure in the country to the collapse of the grids that knocked out power. When started analyzing on industry estimates, came to know that nearly 30 percent of the power generated in India is wasted in transmission and distribution primarily because of leakages and theft. There are certain mechanisms which have been used like legacy power distribution systems, SCADA etc. But Smart Metering technology is the one which is growing and in some years time will be seen implemented all over India. This is a review done to make load analysis of the power distribution to the customers on some such technologies to avoid sustained outages by analyzing momentary outage data and power theft using Hadoop MapReduce.

Big data analytics in smart grids: state‐of‐the‐art, challenges, opportunities, and future directions

“…Hadoop is an open source framework for storing and processing large datasets using the MapReduce programming model [143]. The Hadoop consists of a storage part (known as Hadoop distributed file systems (HDFS)) and processing part (known as MapReduce programming model) [138][139][140]. Primarily, Hadoop splits files into large blocks and distributes them across nodes so as to process data in parallel.…”