A Peer-to-Peer Replica Management Service for High-Throughput Grids

Chazapis, Antony; Zissimos, Antonis; Koziris, Nectarios

doi:10.1109/icpp.2005.12

Cited by 16 publications

(15 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Also, efforts are being done at infrastructure level, such as mixing clusters and desktop machines for P2P-based computational Grids (e.g. [7], [10]) or the PlanetLab platform [19] as a testbed for Grid-P2P applications.…”

Section: Integrated Approaches To Grid and P2p Systemsmentioning

confidence: 99%

Grid and P2P Middleware for Scientific Computing Systems

Xhafa

Pllana

Barolli

2010

2010 International Conference on Complex, Intelligent and Software Intensive Systems

View full text Add to dashboard Cite

Abstract-Grid and P2P systems have achieved a notable success in the domain of scientific and engineering applications, which commonly demand considerable amounts of computational resources. However, Grid and P2P systems remain still difficult to be used by the domain scientists and engineers due to the inherent complexity of the corresponding middleware and the lack of adequate documentation. In this paper we survey recent developments of Grid and P2P middleware in the context of scientific computing systems. The differences on the approaches taken for Grid and P2P middleware as well as the common points of both paradigms are highlighted. In addition, we discuss the corresponding programming models, languages, and applications.

show abstract

Section: Integrated Approaches To Grid and P2p Systemsmentioning

confidence: 99%

Grid and P2P Middleware for Scientific Computing Systems

Xhafa

Pllana

Barolli

2010

2010 International Conference on Complex, Intelligent and Software Intensive Systems

View full text Add to dashboard Cite

show abstract

“…DRLS is a distributed Peer to Peer index containing locations of replicated file instances through LFN (Logical Filename) to PFN (Physical Filename) mappings as described in [11]. The storage subsystem offers two basic primitives: PUT and GET file.…”

Section: Distributed Storage Platformmentioning

confidence: 99%

GridNews: A distributed automatic Greek broadcast transcription system

Dimitriadis

Metallinou

Konstantinou

et al. 2009

2009 IEEE International Conference on Acoustics, Speech and Signal Processing

Self Cite

View full text Add to dashboard Cite

In this paper, a distributed system storing and retrieving Broadcast News data recorded from the Greek television is presented. These multimodal data are processed in a grid computational environment interconnecting distributed data storage and processing subsystems. The innovative element of this system is the implementation of the signal processing algorithms in this grid environment, offering additional flexibility and computational power. Among the developed signal processing modules are: the Segmentor, cutting up the original videos into shorter ones, the Classifier, recognizing whether these short videos contain speech or not, the Greek largevocabulary speech Recognizer, transcribing speech into written text, and finally the text Search engine and the video Retriever. All the processed data are stored and retrieved in geographically distributed storage elements. A user-friendly, web-based interface is developed, facilitating the transparent import and storage of new multimodal data, their off-line processing and finally, their search and retrieval.

show abstract

“…Furthermore, the updates in the LRCs induce a complex and bandwidth-consuming communication scheme between LRCs and RLIs. To this end, in [12] we proposed a RLS based on a Distributed Hash Table (DHT). The underlying DHT is a modified Kademlia peer-to-peer network that enables mutable storage.…”

Section: Distributed Replica Location Service (Drls)mentioning

confidence: 99%

“…To this end, in [12] we proposed a Replica Location Service based on a Distributed Hash Table (DHT). The underlying DHT is a modified Kademlia peer-to-peer network that enables mutable storage.…”

Section: Distributed Rlsmentioning

confidence: 99%

Optimizing Data Management in Grid Environments

Zissimos

Doka

Chazapis

et al. 2009

On the Move to Meaningful Internet Systems: OTM 2009

View full text Add to dashboard Cite

Abstract. Grids currently serve as platforms for numerous scientific as well as business applications that generate and access vast amounts of data. In this paper, we address the need for efficient, scalable and robust data management in Grid environments. We propose a fully decentralized and adaptive mechanism comprising of two components: A Distributed Replica Location Service (DRLS ) and a data transfer mechanism called GridTorrent. They both adopt Peer-to-Peer techniques in order to overcome performance bottlenecks and single points of failure. On one hand, DRLS ensures resilience by relying on a Byzantine-tolerant protocol and is able to handle massive concurrent requests even during node churn. On the other hand, GridTorrent allows for maximum bandwidth utilization through collaborative sharing among the various data providers and consumers. The proposed integrated architecture is completely backwards-compatible with already deployed Grids. To demonstrate these points, experiments have been conducted in LAN as well as WAN environments under various workloads. The evaluation shows that our scheme vastly outperforms the conventional mechanisms in both efficiency (up to 10 times faster) and robustness in case of failures and flash crowd instances.

show abstract

A Peer-to-Peer Replica Management Service for High-Throughput Grids

Cited by 16 publications

References 34 publications

Grid and P2P Middleware for Scientific Computing Systems

Grid and P2P Middleware for Scientific Computing Systems

GridNews: A distributed automatic Greek broadcast transcription system

Optimizing Data Management in Grid Environments

Contact Info

Product

Resources

About