MPI Cluster System Software

Desai, Narayan; Bradshaw, Rick; Lusk, A.; Lusk, Ewing L.

doi:10.1007/978-3-540-30218-6_40

Cited by 13 publications

(11 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This has the useful behavior of providing a constant load on the file service infrastructure, regardless of client scale; all per-client scaling is performed on the clients. This technique was demonstrated in an earlier paper (Desai et al 2004) but has been made much more accessible by MPISH2.…”

Section: Scalable Utility Replacementmentioning

confidence: 99%

See 1 more Smart Citation

A Composition Environment for MPI Programs

Desai

Lusk

Bradshaw

2007

The International Journal of High Performance Computing Applica

Self Cite

View full text Add to dashboard Cite

While MPI is the most common mechanism for expressing parallelism, MPI programs are not composable by using current MPI process managers or parallel shells. We introduce MPISH2, an MPI process manager analogous to serial Unix shells. It allows the composition of MPI and serial Unix utilities with one another to perform scalable tasks across large numbers of Unix clients. This paper discusses in detail issues of process management and parallel tool composition.

show abstract

Section: Scalable Utility Replacementmentioning

confidence: 99%

“…The work we present here has been motivated largely by the gains in system software scalability afforded by the use of MPI in system tools (Desai et al 2004(Desai et al , 2005Ong, Lusk, and Gropp 2001). This approach also has proved positive in terms of overall performance gains.…”

Section: Related Workmentioning

confidence: 99%

A Composition Environment for MPI Programs

Desai

Lusk

Bradshaw

2007

The International Journal of High Performance Computing Applica

Self Cite

View full text Add to dashboard Cite

show abstract

“…MPI is nearly ubiquitous on scalable systems, and it frequently provides access to the fastest networks and the highest-quality parallelism. This approach, discussed in detail in [1], provides an appealing workload for shared systems.…”

Section: Scalabilitymentioning

confidence: 99%

“…In this paper, we discuss the design and implementation of disparity and its use on a SiCortex SC5832 system. This work is an outgrowth of the research described in [1]. Whereas that research validated the utility of MPI libraries for system tools, this work addresses monitoring problems with parallel techniques.…”

Section: Introductionmentioning

confidence: 99%

Disparity: Scalable Anomaly Detection for Clusters

Desai

Bradshaw

Lusk

2008

2008 International Conference on Parallel Processing - Workshops

Self Cite

View full text Add to dashboard Cite

show abstract

“…Code volume was smaller and error handling better in the MPI versions as well. These experiences and performance numbers are detailed in [5]. Details about MPISH and its execution model are available in [6].…”

Section: Mpi-based System Toolsmentioning

confidence: 99%

An Interoperability Approach to System Software, Tools, and Libraries for Clusters

Lusk¹,

Desai²,

Bradshaw³

et al. 2006

The International Journal of High Performance Computing Applica

View full text Add to dashboard Cite

Systems software for clusters typically derives from a multiplicity of sources: the kernel itself, software associated with a particular distribution, site-specific purchased or open-source software, and assorted home-grown tools and procedures that attempt to glue everything together to meet the needs of the users and administrators of a particular cluster. Whether a cluster is a general-purpose resource serving multiple users or dedicated to a single application, getting everything to work together is a challenge. The challenge is partially met by special software distributions for clusters such as OS-CAR or ROCKS. Here we discuss another approach (although it is not inconsistent with existing distributions), in which a small number of concepts are deployed to facilitate the customized integration of various software tools for cluster management, operation, and user jobs. The concepts include (1) a component approach to basic system software such as schedulers, queue managers, process managers, and monitors; (2) a software development kit for constructing networks of system software components, either from scratch or by wrapping "foreign" software, and (3) the use of explicit parallelism in building system tools for high performance. We illustrate this approach with a description of a mid-sized general-purpose cluster operated entirely by software built this way.

show abstract

MPI Cluster System Software

Cited by 13 publications

References 4 publications

A Composition Environment for MPI Programs

A Composition Environment for MPI Programs

Disparity: Scalable Anomaly Detection for Clusters

An Interoperability Approach to System Software, Tools, and Libraries for Clusters

Contact Info

Product

Resources

About