A Survey on Security of the Hadoop Framework in the Environment of Bigdata

Abstract

The world is becoming increasingly digital at the moment. Every day, a significant amount of data is generated by everyone who uses the internet nowadays. The data are critical for carrying out day-to-day operations, as well as assisting corporate management in achieving their objectives and making the best judgments possible based on the information gathered. BigData is the process of merging many hardware and software solutions to deal with extremely huge amounts of data that surpass storage capability. It’s possible that large amounts of data will be generated. Hadoop systems are used in a variety of areas, including healthcare, finance, and government. insurance, and social media, in order to provide a quick and cost-effective big data solution. The Apache Hadoop is a framework for storing and processing data, managing, and distributing large amounts of information over a large number of server nodes. Here are some solutions that work on top of the Apache Hadoop stack to guarantee data security. To get a complete picture of the problem, we decided to conduct an investigation into existing security solutions for Apache Hadoop security in sensitive data which is stored on a huge data platform employing distributed computing on a cluster of commodity devices. The goal of this paper is to provide knowledge of security and Big Data issues.

Stackedmulti‐layersecurity for Hadoop distributed file system usingHSCTsteganography

“…7 Various third-party tools like kerberoes, knox, sentry and so forth were suggested by many authors to secure the data stored in Hadoop cluster. 8 As a different effort cryptography combined with steganography is suggested to protect the data. For encrypting the text RSA algorithm was used.…”

“…Various third‐party tools like kerberoes, knox, sentry and so forth were suggested by many authors to secure the data stored in Hadoop cluster 8 …”

Studying the Security and Privacy Issues of Big Data in the Saudi Medical Sector

“… Encryption: Encryption is the process of encoding data so that it cannot be read by unauthorized users. Hadoop provides encryption mechanisms for data at rest and in transit [29]. For data at rest, Hadoop supports encryption at the file system level using tools like HDFS Transparent Encryption [30].…”