Advancing Monitoring in Microservices Systems

Jiang

J Software Evolu Process

et al. 2022

Due to its development agility, continuous delivery, scalability and other characteristics, the microservice architecture systems (MASs) have provided complex business functions to hundreds of millions of users in many application fields. The operation and maintenance governance for a large number of microservices with complex relationships is crucial to ensuring the stability and reliability of an MAS. Although this research field has received certain attention and produced some innovative results, there is a lack of systematic reviews covering the different aspects of it. In this context, the central objective of this study is to carry out a systematic literature review (SLR) in this field, in an attempt to review existing issues, discuss the main trends, and share the findings with the academia. As a result, we start from more than 500 scientific papers published from 2009 to 2021 and extract 144 most significant papers, identify that the main research directions of this field include load balancing, fault detection, and autoscaling. Subsequently, we provide a comprehensive description of these research directions, discuss them in particular detail. We also determine limitations of current work and discuss new directions worth exploring in the future. Consequently, the outcomes will assist professionals and experts in the industry as well as academic researchers to focus more on operation and maintenance governance of MASs and further improve the relevant methods and theoretical systems in this field.

Section: Research Resultsmentioning

confidence: 99%

Section: Migration Timementioning

confidence: 99%

The operation and maintenance governance of microservices architecture systems: A systematic literature review

Jiang

J Software Evolu Process

et al. 2022

“…A framework for IoT system monitoring and management that combines AllJoyn open-source project (interconnecting IoT devices), MongoDB (Big Data storage), and Storm (real-time data analytics) is proposed in [50]. This work also highlighted how the proposed system helps addressing the limitations of AllJoyn in terms of large-scale EMMCS Edge [34] ZerOps4E Edge [35] FMonE Edge [36] SmartX MVF Cloud [37] CLAMBS Cloud [38] Monitoring cloud Cloud [39] M2CPA Cloud [40] CL-SLAM Cloud [41] CloudProcMon Cloud [42] Self-adaptive monitoring Cloud [43] Network-aware monitoring Cloud [44] Monasca Cloud [45] Instana Kibana Visualization [55] Black-box Monitoring Microservices [56] Non-intrusive techniques Microservices [57] M3 Microservices [58] milliScope Microservices [59] QoE framework Microservices [60] Cilium (Hubble) Microservices [61] ViperProbe Microservices [62] The rise of eBPF Microservices [63] System visibility and security Microservices [64] Container network observability Microservices [65] Apache SkyWalking Microservices [66] OpenTelemetry smart environment monitoring and Big data storage and analytics. CHARISMA [51] discusses the key features of monitoring as well as the main requirements to resource monitoring systems for future 5G deployments and services.…”

Section: A Contributions From Academiamentioning

confidence: 99%

“…The solution claims to be transparent to applications and generates less overhead than state-of-the-art black-box systems. Cinque et al [56] presented their proposal for a unique monitoring framework with non-intrusive techniques based on passive tracing and log analysis to address challenges in current application performance monitoring. A generic monitoring framework Multi-microservices Multi-virtualization Multi-cloud (M3) [57] is introduced to monitor the performance of microservices deployed over heterogeneous virtualization platforms in a multi-cloud environment.…”

Section: A Contributions From Academiamentioning

confidence: 99%

See 1 more Smart Citation

A Survey on Observability of Distributed Edge & Container-Based Microservices

2022

Edge computing is proposed as a technical enabler for meeting emerging network technologies (such as 5G and Industrial Internet of Things), stringent application requirements and key performance indicators (KPIs). It aims to alleviate the problems associated with centralized cloud computing systems by placing computational resources to the network's edge, closer to the users. However, the complexity of distributed edge infrastructures grows when hosting containerized workloads as microservices, resulting in hard to detect and troubleshoot outages on critical use cases such as industrial automation processes. Observability aims to support operators in managing and operating complex distributed infrastructures and microservices architectures by instrumenting end-to-end runtime performance. To the best of our knowledge, no survey article has been recently proposed for distributed edge and containerized microservices observability. Thus, this article surveys and classifies state-of-the-art solutions from various communities. Besides surveying state-of-the-art, this article also discusses the observability concept, requirements, and design considerations. Finally, we discuss open research issues as well as future research directions that will inspire additional research in this area.

ARCHI4MOM: Using Tracing Information to Extract the Architecture of Microservice-Based Systems from Message-Oriented Middleware

Singh

Werle

Koziolek

2022

Software Architecture

Since the beginning of the 21st century the architecture of software systems and especially distributed software systems have seen a considerable evolution making them easier to extend, reuse and manage. As a result, software systems have become more reliable and robust. In addition to the higher requirements for their products, software developers have to deal nowadays with more complex architecture. The challenge lies in the fact that software systems are constituted of components that are more and more autonomous and may be deployed with di erent technologies and in far geographic locations. Building such heterogeneous systems gained popularity since the appearance of Microservices which resulted in a higher performance that could be improved further by including asynchronous communication between the constituting services. All these changes though bene cial, may make the extraction of a documenting model of such systems more tricky. On the one hand such systems provide through their exible architecture a lot of advantages. On the other hand, they are more likely to be changed fast and thus make their documentation less reliable and hence di culties for maintenance and extension will increase. Through our thesis we treat this problem by extending an existing approach of model extraction of microservice-based systems from their tracing data in a way that message-based systems can also be supported. We evaluate then our results using statistical metrics such as precision, recall and F1-score in order to make sure that the accuracy of our extracted model will not be decreased compared to the approach we are extending, which is actually the case. Hence, through our approach, we provide a way to extract performance models to document message-based system in a much easier and less error prone way then the manual alternative. Subsequently, further possible future works such as calculating failure estimation and resolving parametric dependencies are presented. i ZusammenfassungSeitdem Beginn des 21, Jahrhundert hat sich die Architektur der Software Systeme insbesondere verteilte Systeme erheblich entwickelt, so dass sie besser erweiterbar, wiederverwendbar und verwaltet sein können. Im Folge dessen, sind Software Systeme zuverlässiger und robuster geworden. Deswegen, zusätzlich zu den höheren Anforderungen für ihre Produkte, müssen sich Software Entwickler heutzutage mit komplexeren Architekturen auseinandersetzen. Die Herausforderung besteht darin, dass Software Systeme Komponenten umfassen, die immer autonomer werden, mit verschiedenen Technologien bereitgestellt werden können und sich in weit entfernten geographischen Positionen be nden. Das Bauen solcher heterogenen Systemen hat mehr an Popularität gewonnen seitdem erscheinen von Microservices, die für eine höhere Leistung gesorgt haben, die wiederum noch besser sein könnte durch das einsetzen asynchroner Kommunikation zwischen den konstituierenden Services. All diese Änderungen, auch wenn vorteilhaft, können die Extraktion eines dokumentierenden Modells solcher S...