Efficient Message Serialization for Inter-Service Communication in dCache [Slides]

Morschel, Lea; Litvintsev, D.; Rossi, Albert; Starek, Juergen; Sahakyan, Marina; Adeyemi, Olufemi; Garonne, V.

doi:10.2172/1630710

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Serializers are compared in a more general sense in order to understand their strengths and weaknesses. This paper is the summary of a larger scientific thesis [3].…”

Section: Introductionmentioning

confidence: 99%

dCache – Efficient Message Encoding For Inter-Service Communication in dCache: Evaluation of Existing Serialization Protocols as a Replacement for Java Object Serialization

et al. 2020

Self Cite

View full text Add to dashboard Cite

As a well established, large-scale distributed storage system, dCache is used to manage and serve huge amounts of data collected by high energy physics, astrophysics and photon science experiments. Based on a microservices-like architecture, dCache is built as a modular distributed system, where each component provides a different core functionality. These services communicate by passing serialized messages to each other, a core behavior whose performance properties can consequently affect the entire system. This paper compares and evaluates different data serialization protocols in computer science with the objective of replacing and improving upon Java Object Serialization (JOS), which has increasingly presented itself as no longer being sufficiently performant for encoding messages. The criteria for choosing a new framework are collected, analyzed and formalized. The primary motivation for replacing Java serialization for encoding dCache messages is increasing the general speed of message-passing and thereby reducing the round-trip time for user requests. Emphasis is also placed on schema evolution capabilities and framework usability. Approaches for generalizing (de)serialization speed and size measurements based on data structure complexity are introduced, criteria for measuring documentation, learning curve, maintainability and introduction effort are defined. Finally, several selected serialization protocols are evaluated and compared accordingly, concluding with a recommendation for a suitable JOS replacement.

show abstract

“…Serializers are compared in a more general sense in order to understand their strengths and weaknesses. This paper is the summary of a larger scientific thesis [3].…”

Section: Introductionmentioning

confidence: 99%