Distributed computing in a heterogeneous computing environment

Gabriel, Edgar; Resch, Michael; Beisel, Thomas; Keller, Rainer

doi:10.1007/bfb0056574

Cited by 108 publications

(51 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Despite its poor performance, this scheme has been widely used due to its highly portable nature. The PACX-MPI [2] and Firewall-enabled MPICH-G [4] use this scheme.…”

Section: Communication Relay Schemesmentioning

confidence: 99%

“…In PACX-MPI [2], another implementation of MPI aiming to support the coupling of high performance computing systems distributed in a Grid, the communications among multiple private IP clusters are handled by two user-level daemons that allow the library to bundle communications and avoid having thousands of open connections between systems. However, since these daemons are implemented as proxies running in user space, the total bandwidth is only about half of the bandwidth obtained from kernel-level solutions [3].…”

Section: Introductionmentioning

confidence: 99%

“…By using the NAT service, which is generally provided by traditional operating systems, we can also easily apply our proposed scheme to any private IP enabled solutions without modifying operating system kernel. We have benchmarked our scheme and compared it with the user-level two-proxy scheme used in PACX-MPI [2] and Firewall-enabled MPICH-G [4]. The experimental results show that our NAT-based scheme outperforms the user-level two-proxy scheme.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

An NAT-Based Communication Relay Scheme for Private-IP-Enabled MPI over Grid Environments

Choi

Park

Han

et al. 2004

Computational Science - ICCS 2004

View full text Add to dashboard Cite

Abstract. In this paper we propose a communication relay scheme combining the NAT and a user-level proxy to support private IP clusters in Grid environments. Compared with the user-level two-proxy scheme used in PACX-MPI and Firewall-enabled MPICH-G, the proposed scheme shows performance improvement in terms of latency and bandwidth between the nodes located in two private IP clusters. Since the proposed scheme is portable and provides high performance, it can be easily applied to any private IP enabled solutions including the private IP enabled MPICH solution for Globus toolkit.

show abstract

“…Despite its poor performance, this scheme has been widely used due to its highly portable nature. The PACX-MPI [2] and Firewall-enabled MPICH-G [4] use this scheme.…”

Section: Communication Relay Schemesmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

An NAT-Based Communication Relay Scheme for Private-IP-Enabled MPI over Grid Environments

Choi

Park

Han

et al. 2004

Computational Science - ICCS 2004

View full text Add to dashboard Cite

show abstract

“…Two other efforts closely parallel this section of work on DDTs. PACX [19] from HLRS, RUS Stuttgart, requires the heterogeneous data conversion facilities and a project from NEC Europe [16] concentrates on efficient data type representation and transmission in homogeneous systems.…”

Section: Ft-mpi Ddt Performancementioning

confidence: 99%

HARNESS fault tolerant MPI design, usage and performance issues

Fagg

Dongarra

2002

Future Generation Computer Systems

View full text Add to dashboard Cite

Initial versions of MPI were designed to work efficiently on multi-processors which had very little job control and thus static process models. Subsequently forcing them to support a dynamic process model suitable for use on clusters or distributed systems would have reduced their performance. As current HPC collaborative applications increase in size and distribution the potential levels of node and network failures increase. This is especially true when MPI implementations are used as the communication media for GRID applications where the GRID architectures themselves are inherently unreliable thus requiring new fault tolerant MPI systems to be developed. Here we present a new implementation of MPI called FT-MPI that allows the semantics and associated modes of failures to be explicitly controlled by an application via a modified MPI API. Given is an overview of the FT-MPI semantics, design, example applications and some performance issues such as efficient group communications and complex data handling. Also briefly described is the HARNESS g hcore system that handles low-level system operations on behalf of the MPI implementation. This includes details of plug-in services developed and their interaction with the FT-MPI runtime library.

show abstract

“…It could be a huge loss of resources if private clusters are excluded from Grid due to the reason above. Hence there has been much work on making parallel programs be executed over clusters in private networks [1,2,3]. Most of them relay messages using a separate application because it could be a more general solution than kernel-level strategy.…”

Section: Introductionmentioning

confidence: 99%

Universal Execution of Parallel Processes: Penetrating NATs over the Grid

Han

Yeom

et al. 2007

Computational Science – ICCS 2007

View full text Add to dashboard Cite

Abstract. Today, clusters are very important computing resources and many computing centers manage their clusters in private networks. But parallel programs may not work in private clusters. Because hosts in private clusters are not globally reachable, hosts behind different private clusters cannot be reached directly in order to communicate. It will certainly be a huge loss of resources if private clusters are excluded from the computing due to this reason. There has been much research on this issue, but most of them concentrate on user-level relaying because it is a general and easily-implementable solution. However, even wellimplemented, user-level solutions result in much longer communication latency than kernel-level solutions. This paper adopted a novel kernellevel solution and applied it to MPICH-G2. Our scheme is generally applicable, simple and efficient. The experimental results show that our scheme incurs very little overhead except when small messages are transmitted. That is, it supports a more universal computing environment by including private clusters with remarkably little overhead.

show abstract

Distributed computing in a heterogeneous computing environment

Cited by 108 publications

References 5 publications

An NAT-Based Communication Relay Scheme for Private-IP-Enabled MPI over Grid Environments

An NAT-Based Communication Relay Scheme for Private-IP-Enabled MPI over Grid Environments

HARNESS fault tolerant MPI design, usage and performance issues

Universal Execution of Parallel Processes: Penetrating NATs over the Grid

Contact Info

Product

Resources

About