Building messaging substrates for Web and Grid applications

Abstract

Grid application frameworks have increasingly aligned themselves with the developments in Web Services. Web Services are currently the most popular infrastructure based on Service Oriented Architecture (SOA) paradigm. There are three core areas within the SOA framework: a set of capabilities that are remotely accessible, communications using messages, and metadata pertaining to the aforementioned capabilities. In this paper, we focus on issues related to the messaging substrate hosting these services; we base these discussions on the NaradaBrokering system. We outline strategies to leverage capabilities available within the substrate without the need to make any changes to the service implementations themselves. We also identify the set of services needed to build Grids of Grids. Finally, we discuss another technology, HPSearch, which facilitates the administration of the substrate and the deployment of applications via a scripting interface. These issues have direct relevance to scientific Grid applications, which need to go beyond remote procedure calls in client-server interactions to support integrated distributed applications that couple databases, high performance computing codes, and visualization codes.

On the creation & discovery of topics in distributed publish/subscribe systems

“…The QoS pertain to the reliable delivery, playbacks, order, duplicate elimination, global timing services, security and size of the published events and their encapsulated payloads. Additional information regarding NaradaBrokering can be found in Refs [8][9][10][11].…”

“…NaradaBrokering [8][9][10][11] is an open-source, distributed messaging infrastructure based on the publish/subscribe paradigm. The smallest unit of this distributed messaging substrate intelligently processes and routes messages, while working with multiple underlying communication protocols.…”

“…In this paper we also include empirical results from our experiments related to the implementation of our scheme. We have performed these experiments in the context of our system NaradaBrokering [8][9][10][11] which is a distributed messaging infrastructure based on the publish/subscribe paradigm.…”

Reliability of Grid Computing Systems

“…Perhaps the best-known current example of the use of multicasting in grid applications is the Access Grid [201], where large audio and video datasets are broadcast regularly to many participants. However, in these and other uses of multicasting in grid networks [186], best effort multicast is used, which provides high-throughput and low end-to-end delay, but does not provide guaranteed delivery [202].…”

“…In [185,186], a messaging infrastructure was presented for support of communication and large-scale data transfer in grid systems. The infrastructure employed redundant distributed intermediate brokers to form a virtual software overlay network, the NaradaBrokering system, for managing large data streams.…”