P2P-MPI: A Peer-to-Peer Framework for Robust Execution of Message Passing Parallel Programs on Grids

Genaud, Stéphane; Rattanapoka, Choopan

doi:10.1007/s10723-006-9056-2

Cited by 36 publications

(19 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…P2P-MPI [57] is a middleware for developing embarrassingly parallel applications by grouping computing resources of desktop Grids. Typically, a user can request P2P-MPI to transparently find a given number of processors for running a Java application, using the P2P-MPI message passing library, which in turn conforms to MPJ.…”

Section: P2p Middleware and Programming Modelsmentioning

confidence: 99%

Grid and P2P middleware for wide‐area parallel processing

Xhafa

Pllana

Barolli

et al. 2010

Concurrency and Computation

View full text Add to dashboard Cite

SUMMARYGrid computing emerged as a paradigm for high-performance computing and massive parallel processing. Currently, Grid systems have become an important paradigm for efficiently solving large-scale complex problems from many fields. On the other hand, P2P paradigm originated from file-sharing, but each time more is being used for the development of large-scale distributed platforms. Grid and P2P systems have thus followed different trajectories pushed by different motivations, needs and research communities. In fact, both paradigms are evolving in a way that each time they are sharing more common characteristics and are mutually benefiting from their best features. Among these characteristics, we could distinguish the cooperative model for solving complex problems by exploiting their large computing capacity. As such, Grid and P2P systems have achieved notable success, in particular, for e-Science applications, a family of complex applications arising in science and engineering that need considerable computation power. Despite important advances in the design and use of Grid and P2P systems, they remain still difficult to implement and apply to real-life problems. The main difficulties reside in the lack of easy-to-use middleware for Grid and P2P, in the complexities of setting up and in the tedious task of deploying real-world Grid/P2P platforms as well as in experimental studies which are often complex and not easy to repeat. In this paper we survey and analyze the advances in communication libraries and middleware for both Grid and P2P systems as well as their limitations when used in real Grid and P2P infrastructures. We also bring examples of real-life applications of massive data processing that can be efficiently handled through Grid and P2P approaches.

show abstract

Section: P2p Middleware and Programming Modelsmentioning

confidence: 99%

Grid and P2P middleware for wide‐area parallel processing

Xhafa

Pllana

Barolli

et al. 2010

Concurrency and Computation

View full text Add to dashboard Cite

show abstract

“…P2P-MPI: P2P-MPI [11] is a middleware for developing embarrassingly parallel applications by grouping computing resources of desktop Grids. Typically, a user can request P2P-MPI to transparently find a given number of processors for running a Java application, using the P2P-MPI message passing library, which in turn conforms to MPJ.…”

Section: A P2p Middleware and Programming Modelsmentioning

confidence: 99%

Grid and P2P Middleware for Scientific Computing Systems

Xhafa

Pllana

Barolli

2010

2010 International Conference on Complex, Intelligent and Software Intensive Systems

View full text Add to dashboard Cite

Abstract-Grid and P2P systems have achieved a notable success in the domain of scientific and engineering applications, which commonly demand considerable amounts of computational resources. However, Grid and P2P systems remain still difficult to be used by the domain scientists and engineers due to the inherent complexity of the corresponding middleware and the lack of adequate documentation. In this paper we survey recent developments of Grid and P2P middleware in the context of scientific computing systems. The differences on the approaches taken for Grid and P2P middleware as well as the common points of both paradigms are highlighted. In addition, we discuss the corresponding programming models, languages, and applications.

show abstract

“…Having no single point of failure, the most successful P2P architectures are adaptive and self-organizing. While there has been some previous work applying P2P to message passing [7], little attention has been previously paid to the tightly coupled exascale domain. Typically, the per-node footprint of P2P systems is small, making them ideal for HPC use.…”

Section: Research Goalsmentioning

confidence: 99%

Peer-to-peer architectures for exascale computing : LDRD final report.

Report¹,

Mayo²,

Vorobeychik³

et al. 2010

View full text Add to dashboard Cite

The goal of this research was to investigate the potential for employing dynamic, decentralized software architectures to achieve reliability in future high-performance computing platforms. These architectures, inspired by peer-to-peer networks such as botnets that already scale to millions of unreliable nodes, hold promise for enabling scientific applications to run usefully on next-generation exascale platforms (∼ 10 18 operations per second). Traditional parallel programming techniques suffer rapid deterioration of performance scaling with growing platform size, as the work of coping with increasingly frequent failures dominates over useful computation. Our studies suggest that new architectures, in which failures are treated as ubiquitous and their effects are considered as simply another controllable source of error in a scientific computation, can remove such obstacles to exascale computing for certain applications. We have developed a simulation framework, as well as a preliminary implementation in a large-scale emulation environment, for exploration of these "fault-oblivious computing" approaches.

show abstract

P2P-MPI: A Peer-to-Peer Framework for Robust Execution of Message Passing Parallel Programs on Grids

Abstract: Online since Friday, December 15, 2006International audienc

Cited by 36 publications

References 23 publications

Grid and P2P middleware for wide‐area parallel processing

Grid and P2P middleware for wide‐area parallel processing

Grid and P2P Middleware for Scientific Computing Systems

Peer-to-peer architectures for exascale computing : LDRD final report.

Contact Info

Product

Resources

About