Exploring a system architecture of content‐based publish/subscribe system for efficient on‐the‐fly data dissemination

Abstract

Summary In a cloud‐scale publish/subscribe messaging system, it is difficult to partition subscription data among several servers. Without a sophisticated scheme and a system architecture, the messaging system would either waste resources or fail to deliver messages on time. In this study, we propose DRDA, a dynamic replication degree adjustment technology, for efficient message delivery. The technology calculates and maintains the number of subscription replications at a reasonable level by monitoring the statuses of servers, based on the number of subscription replications and the frequency of event dissemination. To verify the effectiveness of our proposed scheme and system architecture, we build a prototype of a content‐based publish/subscribe system that dynamically adjusts the number of replications among brokers. Furthermore, we compare the load balance, resource overhead, and performance of a publish/subscribe system with DRDA with a publish/subscribe system without DRDA. The experimental results show that DRDA outperforms other approaches under various parameter configurations. We have added the prototype code to a GitHub repository to make it publicly available.

Lap: A latency‐aware parallelism framework for content‐based publish/subscribe systems

“…Similar work includes CAPS 34 and RDPA. 35 Other works adapt balancing load to handle workload fluctuation through consistent hashing. 36 These approaches are complementary to our proposed parallelization framework.…”

“…GSEC is able to adjust the number of brokers to adapt to churn workloads through a performance‐aware provisioning technique. Similar work includes CAPS 34 and RDPA 35 . Other works adapt balancing load to handle workload fluctuation through consistent hashing 36 .…”