A Reinforcement Learning Approach to Call Admission Control in HAPS Communication System

Abstract

Abstract. The large changing of link capacity and number of users caused by the movement of both platform and users in communication system based on high altitude platform station (HAPS) will resulting in high dropping rate of handover and reduce resource utilization. In order to solve these problems, this paper proposes an adaptive call admission control strategy based on reinforcement learning approach. The goal of this strategy is to maximize long-term gains of system, with the introduction of cross-layer interaction and the service downgraded. In order to access different traffics adaptively, the access utility of handover traffics and new call traffics is designed in different state of communication system. Numerical simulation result shows that the proposed call admission control strategy can enhance bandwidth resource utilization and the performances of handover traffics.