Joint optimization of service request routing and instance placement in the microservice system

Yu, Yinbo; Yang, Jianfeng; Guo, Chengcheng; Zheng, Hong; He, Jiancheng

doi:10.1016/j.jnca.2019.102441

Cited by 35 publications

(8 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Aiming at minimizing the average response time of user requests, they established an optimization model for the deployment of microservice instances among base stations. Reference [10] considered service requests composed of different microservices in a linear arrangement, and established a multi-objective optimization model to minimize the service time of all requests and the energy consumption of the servers.…”

Section: Literature Reviewmentioning

confidence: 99%

Microservice deployment problem in the edge-side of intelligent factories

Xu¹,

Li²,

Zhang³

2023

Third International Symposium on Computer Engineering and Intelligent Communications (ISCEIC 2022)

View full text Add to dashboard Cite

Microservices is an emerging software development architecture. The orchestration and optimization of microservices can effectively reduce the operating latency and improve the service quality. This paper investigates the problem of microservice deployments in the edge side of the intelligent factory. The microservices make up applications with different topologies. The goal is to minimize the weighted summation of the runtime of applications. The problem is formulated as a mixed-integer programming model and solved by the CPLEX solver. The experimental results show that the microservice deployment scheme presented in this paper is superior to the greedy deployment strategy.

show abstract

Section: Literature Reviewmentioning

confidence: 99%

Microservice deployment problem in the edge-side of intelligent factories

Xu¹,

Li²,

Zhang³

2023

Third International Symposium on Computer Engineering and Intelligent Communications (ISCEIC 2022)

View full text Add to dashboard Cite

show abstract

“…As part of the concept of a low-cost platform, this work is based on the proposal of a microservices architecture; this is capable of supporting general service communication with the central cloud environment [9], and in conjunction with a machine learning subsystem can improve decision support for the pre-diagnosis of infectious diseases [6]. Structurally, the SPIDEP platform was developed using microservices architecture (with nine separate services), in which these services work as asynchronous nodes distributed as groups [26], [50], [51] which communicate via the REST communication protocol [52]. It should be noted that the breakdown of the components into small independent services was based on our preliminary proposal for a software architecture for SPIDEP (with five layers), referred to here as version Beta v1 [14].…”

Section: ) Platformmentioning

confidence: 99%

Telemonitoring System for Infectious Disease Prediction in Elderly People Based on a Novel Microservice Architecture

et al. 2020

View full text Add to dashboard Cite

This article describes the design, development and implementation of a set of microservices based on an architecture that enables detection and assisted clinical diagnosis within the field of infectious diseases of elderly patients, via a telemonitoring system. The proposed system is designed to continuously update a medical database fed with vital signs from biosensor kits applied by nurses to elderly people on a daily basis. The database is hosted in the cloud and is managed by a flexible microservices software architecture. The computational paradigms of the edge and the cloud were used in the implementation of a hybrid cloud architecture in order to support versatile high-performance applications under the microservices pattern for the pre-diagnosis of infectious diseases in elderly patients. The results of an analysis of the usability of the equipment, the performance of the architecture and the service concept show that the proposed e-health system is feasible and innovative. The system components are also selected to give a cost-effective implementation for people living in disadvantaged areas. The proposed e-health system is also suitable for distributed computing, big data and NoSQL structures, thus allowing the immediate application of machine learning and AI algorithms to discover knowledge patterns from the overall population.

show abstract

“…To optimize resource cost with deadline constraints, the elastic scheduling method 8 prioritizes running resources to the tasks in the critical path of microservice workflow. For balancing the resource usage with consideration of user requests and thus reducing the energy consumption, the routes of user requests are modeled as a critical aspect 9 . All these optimization problems are workflow‐dependent.…”

Section: Introductionmentioning

confidence: 99%

“…reducing the energy consumption, the routes of user requests are modeled as a critical aspect. 9 All these optimization problems are workflow-dependent.…”

mentioning

confidence: 99%

Characterizing and synthesizing the workflow structure of microservices in ByteDance Cloud

Wen

Cheng

Yin

2022

J Software Evolu Process

View full text Add to dashboard Cite

Modern Cloud applications have evolved from monolithic systems to numerous distributed microservices whose workflows interact via Remote Procedure Calls (RPCs). The benchmarks focusing on individual microservice components are insufficient because the reference relationships between components, which form the microservice workflow structure, are another critical aspect of microservice applications. Unfortunately, understanding the characteristics of microservice workflow in the production Cloud remains a missing piece in the literature, which prevents the representative of microservice benchmarks. In this paper, we fill this gap by characterizing and synthesizing the microservice workflows based on the trace data of the Toutiao application that is running on ByteDance Cloud. We examine the microservice workflows starting from DAG graphs, introduce observed properties that are easy to ignore but important, show the artificiality of the workflow by statistic description, and explore the high cost of network overhead. We further synthesize the workflow following the characteristics observed. The extensive evaluations show that the synthesized microservice workflows have consistent statistical characteristics as the production ones. A case study applying the synthesized workflows proves its usability.

show abstract

Joint optimization of service request routing and instance placement in the microservice system

Cited by 35 publications

References 25 publications

Microservice deployment problem in the edge-side of intelligent factories

Microservice deployment problem in the edge-side of intelligent factories

Telemonitoring System for Infectious Disease Prediction in Elderly People Based on a Novel Microservice Architecture

Characterizing and synthesizing the workflow structure of microservices in ByteDance Cloud

Contact Info

Product

Resources

About