On the Design of a Big Data based Real-Time Network Traffic Analysis Platform

Abstract

Big data is one of the most spotlighted technological trends in these days, enabling new methods to handle huge volume of complicated data for a broad range of applications. Real-time network traffic analysis essentially deals with big data, which is comprised of different types of log data from various sensors. To tackle this problem, in this paper, we devise a big data based platform, RENTAP, to detect and analyse malicious network traffic. Focused on military network environment such as closed network for C4I systems, leading big data based solutions are evaluated to verify which combination of the solutions is the best design for network traffic analysis platform. Based on the selected solutions, we provide detailed functional design of the suggested platform.

Big data based Network Traffic Feature Extraction

“…However, due to the recent development of hacking technology, traffic with encrypted payload is increasing, making it difficult to utilize existing traffic analysis methods [3] [4]. To solve this problem, a traffic analysis method applying various analysis techniques based on Big Data is being studied.…”