Implementing a scalable XML publish/subscribe system using relational database systems

Tian, Feng; Reinwald, Berthold; Pirahesh, Hamid; Mayr, Tobias; Myllymaki, Jussi

doi:10.1145/1007568.1007623

Cited by 56 publications

(38 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Because the abstract model of nested data collections is (essentially) a subset of XML, we can leverage and adapt existing XML-based query processing [7] and optimization techniques [8] for managing nested collections. For example, algorithms for XML-based publish and subscribe architectures [23] are relevant for applying actor scope parameters to incoming data streams, and iteration-scope expressions can leverage work in XML query optimization and on languages such as XPathLog [16].…”

Section: Resultsmentioning

confidence: 99%

Collection-Oriented Scientific Workflows for Integrating and Analyzing Biological Data

McPhillips

Bowers

Ludäscher

2006

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. Steps in scientific workflows often generate collections of results, causing the data flowing through workflows to become increasingly nested. Because conventional workflow components (or actors) typically operate on simple or application-specific data types, additional actors often are required to manage these nested data collections. As a result, conventional workflows become increasingly complex as data becomes more nested. This paper describes a new paradigm for developing scientific workflows that transparently manages nested data collections. Collection-oriented workflows have a number of advantages over conventional approaches including simpler workflow designs (e.g., requiring fewer actors and control-flow constructs) that are invariant under changes in data nesting. Our implementation within the Kepler scientific workflow system enables the explicit representation of collections and collection schemas, concurrent operation over collection contents via multi-level pipeline parallelism, and allows collection-aware actors to be composed readily from conventional actors.

show abstract

Section: Resultsmentioning

confidence: 99%

Collection-Oriented Scientific Workflows for Integrating and Analyzing Biological Data

McPhillips

Bowers

Ludäscher

2006

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

“…In such systems, publishers label each message with a subject from a pre-defined set, and users subscribe to all the messages in a specific subject. [38]. These approaches typically support a subset of XPath 1.0 [15].…”

Section: Related Systemsmentioning

confidence: 99%

Towards an Internet-Scale XML Dissemination Service1

DIAO

RIZVI

FRNAKLIN

2004

Proceedings 2004 VLDB Conference

View full text Add to dashboard Cite

Publish/subscribe systems have demonstrated the ability to scale to large numbers of users and high data rates when providing content-based data dissemination services on the Internet. However, their services are limited by the data semantics and query expressiveness that they support. On the other hand, the recent work on selective dissemination of XML data has made significant progress in moving from XML filtering to the richer functionality of transformation for result customization, but in general has ignored the challenges of deploying such XML-based services on an Internet-scale. In this paper, we address these challenges in the context of incorporating the rich functionality of XML data dissemination in a highly scalable system. We present the architectural design of ONYX, a system based on an overlay network. We identify the salient technical challenges in supporting XML filtering and transformation in this environment and propose techniques for solving them. IntroductionA large number of emerging applications, such as mobile services, stock tickers, sports tickers, personalized newspaper generation, network monitoring, traffic monitoring, and electronic auctions, has fuelled an increasing interest in ContentBased Data Dissemination (CBDD). CBDD is a service that delivers information to users (equivalently, applications or organizations) based on the correspondence between the content of the information and the user data interests. Figure 1 shows the context in which a data dissemination system providing this service operates. Users subscribe to the service by providing profiles expressing their data interests. Data sources publish their data by pushing messages to the system. The system delivers to each user the messages that match her data interests; these messages are presented in the format required by the user.Over the past few years, XML has rapidly gained popularity as the standard for data exchange in enterprise intranets and on the Internet. The ability to augment data with semantic and structural information using XML-based encoding raises the potential for more accurate and useful delivery of data. In the context of XML-based data dissemination, user profiles can involve constraints over both the structure and value of XML fragments, resulting in potentially more precise filtering of XML messages. In many emerging applications, the relevant XML messages also need to be transformed for data and application integration, personalization, and adaptation to wireless devices.While . Integrating XML processing into such distributed environments appears to be a natural approach to supporting large-scale XML dissemination. ChallengesDistributed pub/sub systems partition the profile population to multiple nodes and direct the message flow to the nodes hosting profiles based on the content of messages (referred to as content-driven routing). Integrating XML into contentdriven routing, however, brings the following key challenges. As XML mixes structural and value-based information, content-drive...

show abstract

“…The XML document constitutes the content to be selectively disseminated. XPath expressions 1 have been widely proposed for modeling such filters [2,7,5,10,9,4,13]. An XPath expression (XPE) can specify filter constraints on the document's structure, its attributes, and its content.…”

Section: Introductionmentioning

confidence: 99%