Deep Reinforcement Learning for Mobile Video Offloading in Heterogeneous Cellular Networks

Abstract

Heterogeneous cellular networks can balance mobile video loads and reduce cell arrangement costs, which is an important technology of future mobile video communication networks. Because of the characteristics of non-convexity of the mobile offloading problem, the design of the optimal strategy is an essential issue. For the sake of ensuring users' quality of service and the long-term overall network utility, this article proposes the distributive optimal method by means of multiple agent reinforcement learning in the downlink heterogeneous cellular networks. In addition, to solve the computational load issue generated by the large action space, deep reinforcement learning is introduced to gain the optimal policy. The learning policy can provide a near-optimal solution efficiently with a fast convergence speed. Simulation results show that the proposed approach is more efficient at improving the performance than the Q-learning method.

Optimal path strategy for the web computing under deep reinforcement learning

“…As the web computing emerge, people combine the existing transportation system with the web computing technology, propose the concept of intelligent transportation and apply the web computing technology to the construction of intelligent transportation systems, which make the intelligent transportation system become an inevitable choice to improve the development of road traffic in the urban process, the combination of intelligent transportation and the web computing can further improve our current poor traffic problems. Urban road traffic is an important part of the urban infrastructure, urban lifeline and blood vessels and carrier of urban people stream and logistics; it plays an important role in urban transportation, smart cities empower cities through technological innovation, through terminal empowerment, scene empowerment, industrial empowerment and ecological empowerment, accelerate the promotion of industrial economy, governmental governance, benefit for the people service, resource environment and infrastructure intelligence level, complement the shortcomings of public service shortage and reduce “cost” of public services, realize the supply-side structural reform of urban services, make cities better meet the requirements of citizen life, enterprise development and local government management (Zhao et al , 2018).…”

An Incentive Strategy of Shiftable Load Participation in Demand Response Based on User Electricity Preference

“…This is also consistent with the fact that with the expanding volume of calls, the SLs' comfort utility decreases faster and faster, with C" (s) > 0. In principal-agent theory, the assumption of participation cost is usually set in the form of quadratic (Zhao et al, 2018;Sun et al, 2019).…”