Learning-Based Autonomous Channel Access in the Presence of Hidden Terminals

Shao, Yulin; Cai, Yucheng; Wang, Taotao; Guo, Ziyang; Liu, Peng; Luo, J.; Gündüz, Deniz

doi:10.1109/tmc.2023.3282790

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article2

Other1

Relationship

Self Cite0

Independent3

Authors

Journals

Cited by 3 publications

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Dynamic MAC Protocol for Wireless Spectrum Sharing via Hyperdimensional Self-Learning

Ni,

Abraham,

Issa

et al. 2024

IEEE Access

View full text Add to dashboard Cite

Dynamic MAC Protocol for Wireless Spectrum Sharing via Hyperdimensional Self-Learning

Ni,

Abraham,

Issa

et al. 2024

IEEE Access

View full text Add to dashboard Cite

Learning Random Access Schemes for Massive Machine-Type Communication With MARL

Jadoon,

Pastore,

Navarro

et al. 2024

Trans. Mach. Learn. Comm. Netw.

View full text Add to dashboard Cite

This paper investigates various multi-agent reinforcement learning (MARL) techniques for designing grant-free random access (RA) schemes suitable for low-complexity, low-power battery-operated devices in massive machine-type communication (mMTC). Previous studies on RA with MARL have shown limitations in terms of scalability and suitability for mMTC. To address scalability and practicality of the proposed methods, we examine the impact of excluding agent identification in the observation vector of each agent on network performance. We employ value decomposition networks (VDN) and QMIX algorithms with parameter sharing (PS) and compare their policies with the deep recurrent Qnetwork (DRQN). Our simulation results demonstrate that the MARL-based RA schemes can achieve a better throughput-fairness trade-off between agents without having to condition on the agent identifiers. We also present a correlated traffic model, which is more descriptive of mMTC scenarios, and show that the proposed algorithm can easily adapt to traffic non-stationarities. Moreover, the robustness of the proposed method in terms of scalability is also shown through simulations.INDEX TERMS Massive machine-type communications, MARL, reinforcement learning, grant-free random access, scalability.1 This article has been accepted for publication in IEEE Transactions on Machine Learning in Communications and Networking. This is the author's version which has not been fully edited an content may change prior to final publication.

show abstract