Optimizing Throughput Performance in Distributed MIMO Wi-Fi Networks Using Deep Reinforcement Learning

Abstract

This paper explores the feasibility of leveraging concepts from deep reinforcement learning (DRL) to enable dynamic resource management in Wi-Fi networks implementing distributed multi-user MIMO (D-MIMO). D-MIMO is a technique by which a set of wireless access points are synchronized and grouped together to jointly serve multiple users simultaneously. This paper addresses two dynamic resource management problems pertaining to D-MIMO Wi-Fi networks: (i) channel assignment of D-MIMO groups, and (ii) deciding how to cluster access points to form D-MIMO groups, in order to maximize user throughput performance. These problems are known to be NP-Hard and only heuristic solutions exist in literature. We construct a DRL framework through which a learning agent interacts with a D-MIMO Wi-Fi network, learns about the network environment, and is successful in converging to policies which address the aforementioned problems. Through extensive simulations and on-line training based on D-MIMO Wi-Fi networks, this paper demonstrates the efficacy of DRL in achieving an improvement of 20% in user throughput performance compared to heuristic solutions, particularly when network conditions are dynamic. This work also showcases the effectiveness of DRL in meeting multiple network objectives simultaneously, for instance, maximizing throughput of users as well as fairness of throughput among them.

Introducing Reinforcement Learning in the Wi-Fi MAC Layer to Support Sustainable Communications in e-Health Scenarios

“…The RL-based algorithms can be deployed in IEEE 802.11 standard to optimize the existing techniques and the defined parameters, which lead to reducing the collision probability, increased throughput, and optimized frame length [22], [23], [24]. Recent studies demonstrate that Deep RL (DRL) algorithm can improve the handovers in mmWave communications [25], optimize the resource unit allocation for multi-user scenarios [26], configure the channel bonding [27], or address the channel allocation and AP clustering issues in MIMO networks [28]. Other studies on RL-based algorithms focus on Wi-Fi management, such as the works presented in [29], [30] for channel and band selection or management architec-ture [31].…”