Spatio–Temporal Edge Service Placement: A Bandit Learning Approach

Abstract

Shared edge computing platforms deployed at the radio access network are expected to significantly improve quality of service delivered by Application Service Providers (ASPs) in a flexible and economic way. However, placing edge service in every possible edge site by an ASP is practically infeasible due to the ASP's prohibitive budget requirement. In this paper, we investigate the edge service placement problem of an ASP under a limited budget, where the ASP dynamically rents computing/storage resources in edge sites to host its applications in close proximity to end users. Since the benefit of placing edge service in a specific site is usually unknown to the ASP a priori, optimal placement decisions must be made while learning this benefit. We pose this problem as a novel combinatorial contextual bandit learning problem. It is "combinatorial" because only a limited number of edge sites can be rented to provide the edge service given the ASP's budget. It is "contextual" because we utilize user context information to enable finer-grained learning and decision making. To solve this problem and optimize the edge computing performance, we propose SEEN, a Spatial-temporal Edge sErvice placemeNt algorithm. Furthermore, SEEN is extended to scenarios with overlapping service coverage by incorporating a disjunctively constrained knapsack problem. In both cases, we prove that our algorithm achieves a sublinear regret bound when it is compared to an oracle algorithm that knows the exact benefit information. Simulations are carried out on a real-world dataset, whose results show that SEEN significantly outperforms benchmark solutions.

Energy aware cloud‐edge service placement approaches in the Internet of Things communications

“…Chen et al 38 proposed new efficient learning algorithm to answer the service placement problem for application service providers (ASP) in edge computing. The algorithm is called spatial‐temporal edge service placement (SEEN).…”

Artificial Intelligence-Empowered Edge of Vehicles: Architecture, Enabling Technologies, and Applications

“…Each time an option is selected, a reward is obtained as feedback, and the action selection is repeated to focus the action on the best arm to maximize the expected total reward in a period of time. To cope with the unknown service requirements in the changing user groups, reference [60] proposed a combined context bandit learning problem. A spatiotemporal edge service placement algorithm is used to solve the problem.…”

Human-Like Hybrid Caching in Software-Defined Edge Cloud

“…Furthermore, according to [11], the popularity of a single content per time period is consistent with the Zipf distribution. For content fine-grained characteristics, we use real data sets [23]. Thus, we can obtain the content popularity of all requests for a time slot.…”