The fifth generation of mobile networks evolved to serve applications with distinct requirements, which results in a high management complexity due to simultaneous real-time tasks. In the physical layer, code words that allow proper data exchange between the Base Station (BS) and the served users must be chosen. While, in higher layers, the BS must choose users to be served in a given transmission opportunity. There are approaches based on Machine Learning (ML) to solve these combined tasks. However, due to the high amount of possible inputs, a challenge is the availability of data to train the models. In some cases, there may not even exist a predefined optimal answer to use as a "label" for supervised approaches. In this paper, we evaluate solutions for the combined problems of beam selection and user scheduling with Reinforcement Learning (RL), which does not need labels, as a solution for problems without a predefined answer. The algorithms were proposed for Problem Statement 6 of the challenge organized by the International Telecommunication Union (ITU) in 2021, which ranked as the finalists. We compare the approaches in relation to the cumulative reward received by the agents and show a performance comparison of different RL approaches by comparing them with baselines developed for the challenge. The paper also shows how the action taken by the trained agents affect network operation by comparing the number of packets transmitted, which is highly related to the proper selection of users and code words.

Resumo-Este artigo apresenta o estágio atual de implantação da PA5Ge, a qualé uma rede móvel baseada em funcionalidades da quarta (4G) e quinta (5G) gerações, licenciada para operação com fins científicos e experimentais na banda de 700 MHz. A PA5Ge possui características modernas como a virtualização das funções de rede (VNFs) e arquitetura de acesso-rádio centralizada (C-RAN). Um de seus objetivosé servir de plataforma experimental para pesquisas acadêmicas em 5G e redes futuras (B5G). Outro objetivoé gerar know-how visandoà utilização de recursos 4G/5G nas redes comunitárias em localidades afastadas dos centros urbanos e não atendidas por operadoras comerciais. Neste contexto, a principal contribuição do artigoé descrever o projeto e etapas para implantação da PA5Ge, desde aspectos de licenciamento a técnicos, de maneira a fomentar iniciativas semelhantes de estabelecimento de plataformas para pesquisa experimental em 4G/5G/B5G, e também as noâmbito da engenharia humanitária através das telecomunicações.

No abstract