A novel hybrid framework based on temporal convolution network and transformer for network traffic prediction

Abstract

Background Accurately predicting mobile network traffic can help mobile network operators allocate resources more rationally and can facilitate stable and fast network services to users. However, due to burstiness and uncertainty, it is difficult to accurately predict network traffic. Methodology Considering the spatio-temporal correlation of network traffic, we proposed a deep-learning model, Convolutional Block Attention Module (CBAM) Spatio-Temporal Convolution Network-Transformer, for time-series prediction based on a CBAM attention mechanism, a Temporal Convolutional Network (TCN), and Transformer with a sparse self-attention mechanism. The model can be used to extract the spatio-temporal features of network traffic for prediction. First, we used the improved TCN for spatial information and added the CBAM attention mechanism, which we named CSTCN. This model dealt with important temporal and spatial features in network traffic. Second, Transformer was used to extract spatio-temporal features based on the sparse self-attention mechanism. The experiments in comparison with the baseline showed that the above work helped significantly to improve the prediction accuracy. We conducted experiments on a real network traffic dataset in the city of Milan. Results The results showed that CSTCN-Transformer reduced the mean square error and the mean average error of prediction results by 65.16%, 64.97%, and 60.26%, and by 51.36%, 53.10%, and 38.24%, respectively, compared to CSTCN, a Long Short-Term Memory network, and Transformer on test sets, which justified the model design in this paper.

TOR-GAN: A Transformer-Based OFDM Signals Reconstruction GAN

“…Furthermore. In 2023, Zhiwei Zhang et al [28] applied the transformer to network traffic prediction and achieved good accuracy by incorporating the CBAM attention mechanism into their model. Additionally, Dexin Zhang et al [29] introduced an OFDM signal-detection system based on the transformer framework that leverages orthogonal frequency division multiplexing and index modulation techniques, outperforming existing DL detectors with slightly increased complexity.…”