Multi-Agent Learning and Bargaining Scheme for Cooperative Spectrum Sharing Process

Abstract

Recently, the lack of spectrum resources has become a key technical bottleneck to develop the Industrial Internet of Things (IIoT). Based on cognitive radio technology, the cognitive IIoT (CIIoT) paradigm can improve spectrum utilization via opportunistically accessing the idle spectrum bands. In this study, a novel cooperative spectrum sharing scheme is presented for the CIIoT system platform. The main challenge of our scheme is to effectively share the limited spectrum resource via cooperative sensing and dynamic accessing techniques. To achieve a mutually desirable solution for different CIIoT devices, we design a learning game model using the ideas of multi-agent reinforcement learning (MARL) and the negotiated aspirations bargaining solution (NABS). In the learning mechanism, individual CIIoT devices adaptively select their cooperative sensing policy according to the MARL model. In the bargaining mechanism, the available spectrum resource is dynamically shared through the NABS, which is obtained based on the devices' selected sensing policy. By investigating the contribution of MARL to game theory, the proposed scheme can effectively guide intelligent CIIoT devices toward a socially optimal outcome. Numerical simulation results demonstrate that the normalized device payoff, CIIoT system throughput and device fairness of our approach are better than those of existing benchmark protocols. Finally, we present the key challenges and future direction of our research in the CIIoT system operations.

Cooperative Game-Based Resource Allocation Scheme for Heterogeneous Networks with eICIC Technology

“…It is suggested as an alternative to Nash's solution, which was suggested 25 years earlier. Te main diference between the two solutions is that the Nash solution satisfes the IIA axiom, while the KSS solution satisfes the axiom of monotonicity [9,10].…”

“…In this study, we adopt the basic idea of cooperative game theory to develop a novel resource control scheme for the eICIC-based HetNet platform. From the perspective of coordination, the MBS, SBSs, and IoT devices cooperate and difuse information so as to obtain a globally optimal solution to maximize the HetNet system performance [8,9].…”