Big Data based approach to Network Security and intelligence

Abstract

Big data analysis technologies and machine learning techniques are essential for examining and forecasting the state of network security as global concerns about cyber security grow. Models for monitoring network security have a number of challenges, including resource consumption, inaccuracies, low processing efficiency, and incompatibility with real-time and large-scale scenarios. This paper proposes a novel approach to Network Security Situation Awareness (NS-SA) using Big Data (BD) analytics and machine learning. The proposed approach addresses the limitations of existing NS-SA models by leveraging data purification and simplification techniques, and by employing an updated back propagation (BP) neural network to construct an NS BD analysis model. The paper provides a comprehensive explanation of the model's structure and outlines the relevant model techniques. Extensive testing has been conducted to ensure the model's accuracy and applicability in understanding NS scenarios. This study focuses on MATLAB and Python-based implementation of a neural network for network security using a big data approach. The results demonstrate the potential and value of the proposed model in accurately assessing and forecasting NS conditions. The proposed approach has several advantages over existing NS-SA models. It is more efficient in terms of resource usage, it is more accurate in its analysis of network data, It is more applicable in real-time and large-scale scenarios and it is more robust to noise and heterogeneity in network data.