Self-Organizing Networks: A Packet Scheduling Approach for Coverage/Capacity Optimization in 4G Networks Using Reinforcement Learning

Abstract

The next generation mobile networks LTE and LTE-A are all-IP based networks. In such IP based networks, the issue of Quality of Service (QoS) is becoming more and more critical with the increase in network size and heterogeneity. In this paper, a Reinforcement Learning (RL) based framework for QoS enhancement is proposed. The framework achieves the coverage/capacity optimization by adjusting the scheduling strategy. The proposed selfoptimization algorithm uses coverage/capacity compromise in Packet Scheduling (PS) to maximize the capacity of an eNB subject to the condition that minimum coverage constraint is not violated. Each eNB has an associated agent that dynamically changes the scheduling parameter value of an eNB. The agent uses the RL technique of Fuzzy Q-Learning (FQL) to learn the optimal scheduling parameter. The learning framework is designed to operate in an environment with varying traffic, user positions, and propagation conditions. A comprehensive analysis on the obtained simulation results is presented, which shows that the proposed approach can significantly improve the network coverage as well as capacity in terms of throughput.

A Novel Stochastic Learning Automata Based SON Interference Mitigation Framework for 5G HetNets

“…This dip in the performance of cells for edge users is because of the rising interference level in the environment as all femtocells start to operate at maximum capacity to match the target user data rate. This observation is similar to [26], [27], where performance degrades as traffic density and user demands increases. However, a combination of new disruptive technologies for 5G like directional antennas, massive MIMO and millimetre spectrum wave can provide us with more frequency bandwidth and data rates while at the same time reducing the interference as pointed out in [28].…”

Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future

“…An agent can be associated with each serving station in a cellular network to assist in learning the optimal scheduling parameters to enhance the network Quality-of-Service (QoS) [78]. A promising application of reinforcement learning at the physical layer of communication networks is power control and optimization.…”