Learning-Based Multi-Channel Access in 5G and Beyond Networks With Fast Time-Varying Channels

Abstract

We propose a learning-based scheme to investigate the dynamic multi-channel access (DMCA) problem in the fifth generation (5G) and beyond networks with fast time-varying channels wherein the channel parameters are unknown. The proposed learning-based scheme can maintain near-optimal performance for a long time, even in the sharp changing channels. This scheme greatly reduces processing delay, and effectively alleviates the error due to decision lag, which is cased by the nonimmediacy of the information acquisition and processing. We first propose a psychology-based personalized quality of service model after introducing the network model with unknown channel parameters and the streaming model. Then, two access criteria are presented for the living streaming model and the buffered streaming model. Their corresponding optimization problems are also formulated. The optimization problems are solved by learning-based DMCA scheme, which combines the recurrent neural network with deep reinforcement learning. In the learningbased DMCA scheme, the agent mainly invokes the proposed prediction-based deep deterministic policy gradient algorithm as the learning algorithm. As a novel technical paradigm, our scheme has strong universality, since it can be easily extended to solve other problems in wireless communications. The real channel data-based simulation results validate that the performance of the learning-based scheme approaches that derived from the exhaustive search when making a decision at each time-slot, and is superior to the exhaustive search method when making a decision at every few time-slots.

Wireless Channel Prediction of GRU Based on Experience Replay and Snake Optimizer

“…In an epoch of industrial informatization, the 5th Generation Mobile Communication Technology (5G) [ 1 ] has become one of the most popular technologies in the world [ 2 ]. With the explosive increase in smart terminals, communication systems should meet the needs of more dense, frequent, secure, and efficient user communication.…”

Joint Resource Management for MC-NOMA: A Deep Reinforcement Learning Approach

“…An attention-based neural network was applied to capture the sequential relations between the input and output of channel assignment problem. In our recent works, we studied multi-channel access in fast-changing channels [25], joint virtual network function placement-and-routing [26], and user grouping of NOMA systems [27], by utilizing a new policy gradient-based DRL technique. In this paper, we are interested in a different problem of joint subcarrier assignment and power allocation in an MC-NOMA system with imperfect SIC.…”