Ibis: Real-world problem solving using real-world grids

Bal, Henri E.; Drost, Niels; Kemp, Roelof; Maassen, Jason; Nieuwpoort, Rob V. van; Reeuwijk, C. van; Seinstra, F.J.

doi:10.1109/ipdps.2009.5160960

Cited by 3 publications

(4 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recently, the software produced by the Ibis project (which includes JEL as one of its core components) has been put to the test in two international competitions [2] organized by the IEEE Technical Committee on Scalable Computing, as part of the CCGrid 2008 (Lyon, France) and Cluster/Grid 2008 (Tsukuba, Japan) international conferences.…”

Section: Competitionsmentioning

confidence: 99%

“…• Satin [5], a divide-and-conquer model • Java RMI [11], an object-oriented RPC model • GMI [12], a group method invocation model • MPJ [9], a Java binding for MPI-1 • RepMI [12], a replicated object model • Maestro [10], a fault-tolerant and self-optimizing dataflow model • Jorus [10], a user-transparent parallel model for multimedia computing As JEL is a generic model, it also supports other programming models. In addition to the models listed, we have implemented a number of prototype programming models, including data parallel, master-worker, and Bulk Synchronous Parallel (BSP) models.…”

Section: Applicability Of Jelmentioning

confidence: 99%

“…Figure 3 shows the position of JEL in the software stack of the Ibis project. All programming models implemented in the Ibis project use JEL to track resources, notably: Satin 5, a divide‐and‐conquer model Java RMI 11, an object‐oriented RPC model GMI 12, a group method invocation model MPJ 9, a Java binding for MPI‐1 RepMI 12, a replicated object model Maestro 10, a fault‐tolerant and self‐optimizing dataflow model Jorus 10, a user‐transparent parallel model for multimedia computing …”

Section: Applicability Of Jelmentioning

confidence: 99%

“…We augmented the IPL with our JEL resource tracking model, leading to a software system which can efficiently run applications on clusters, grids, P2P systems, and clouds. Using the software§ developed in this project, including our implementations of JEL, we have been the first prize winner in a number of international competitions 10. Notably, our winning submission in the Fault‐Tolerant Category of the DACH 2008 Challenge¶ Cluster/Grid 2008 in Tsukuba, Japan, made extensive use of the JEL model for detecting and reporting node failures.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

JEL: unified resource tracking for parallel and distributed applications

Drost¹,

Nieuwpoort²,

Maassen³

et al. 2010

Concurrency and Computation

View full text Add to dashboard Cite

SUMMARYWhen parallel applications are run in large scale distributed environments such as grids, peer-to-peer systems, and clouds, the set of resources used can change dynamically as machines crash, reservations end, and new resources become available. It is vital for applications to respond to these changes. Therefore, it is necessary to keep track of the available resources -a problem which is known to be notoriously difficult.In this paper we argue that resource tracking must be provided as standard functionality in lower parts of the software stack. We propose a general solution to resource tracking: the Join-Elect-Leave (JEL) model. JEL provides unified resource tracking for parallel and distributed applications across environments. JEL is a simple yet powerful model based on notifying when resources have Joined or Left the computation.We demonstrate that JEL is suitable for resource tracking in a wide variety of programming models, ranging from the fixed resource sets traditionally used in MPI-1 to flexible grid-oriented programming models. We compare several JEL implementations, and show these to perform and scale well in several real-world scenarios involving grids, clouds and peer-to-peer systems applied concurrently, and wide-area systems with failing resources. Using JEL, we have won first prize in a number of international distributed computing competitions.

show abstract

Section: Competitionsmentioning

confidence: 99%

Section: Applicability Of Jelmentioning

confidence: 99%

Section: Applicability Of Jelmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

JEL: unified resource tracking for parallel and distributed applications

Drost¹,

Nieuwpoort²,

Maassen³

et al. 2010

Concurrency and Computation

View full text Add to dashboard Cite

show abstract

Zorilla: a peer‐to‐peer middleware for real‐world distributed systems

Drost¹,

Nieuwpoort²,

Maassen³

et al. 2011

Concurrency and Computation

View full text Add to dashboard Cite

SUMMARYThe inherent complex nature of current distributed computing architectures hinders the widespread adoption of these systems for mainstream use. In general, users have access to a highly heterogeneous set of compute resources, which may include clusters, grids, desktop grids, clouds, and other compute platforms. This heterogeneity is especially problematic when running parallel and distributed applications. Software is needed which easily combines as many resources as possible into one coherent computing platform.In this paper, we introduce Zorilla: peer-to-peer (P2P) middleware that creates a single distributed environment from any available set of compute resources. Zorilla imposes minimal requirements on the resource used, is platform independent, and does not rely on central components. In addition to providing functionality on bare resources, Zorilla can exploit locally available middleware. Zorilla explicitly supports distributed and parallel applications, and allows resources from multiple sites to cooperate in a single computation.Zorilla makes extensive use of both virtualization and P2P techniques. We will demonstrate how virtualization and P2P combine into a simple design, while enhancing functionality and ease of use. Together, these techniques bring our goal a step closer: transparent, easy use of resources, even on very heterogeneous distributed systems.

show abstract