Efficient parallel processing on low-cost clusters with GAMMA active ports

Chiola, Giovanni; Ciaccio, Giuseppe

doi:10.1016/s0167-8191(99)00108-8

Cited by 22 publications

(17 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…With additional implementation efforts, environment specific protocol stacks (such as GAMMA [2]) can be developed to further enhance the network throughput. Many network infrastructures support a form of hardware multicast or broadcast.…”

Section: Overview Of Broadcasting Methodsmentioning

confidence: 99%

“…The peak performance of communications is limited by the physical properties of the underlying network, but previous studies [1,2] concluded that the performance of real-life parallel applications is much more sensitive on different software overheads. Due to the inefficiencies and overheads at the levels of application, message passing subsystems (such as PVM [3] or MPI [4]), and operating systems, the physical transfer time itself -especially for smaller messages -is only a fraction of the total application-level delay.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Asynchronous Distributed Broadcasting in Cluster Environment

Juhász

Kovács

2004

Recent Advances in Parallel Virtual Machine and Message Passing Interface

View full text Add to dashboard Cite

Abstract. Improving communication performance is an important issue in cluster systems. This paper investigates the possibility of accelerating group communication at the level of message passing libraries. A new algorithm for implementing the broadcast communication primitive will be introduced. It enhances the performance of fully-switched cluster systems by using message decomposition and asynchronous communication. The new algorithm shows the dynamism and the portability of the software solutions, while it has a constant asymptotic time complexity achieved only with hardware support before. Test measurements show that the algorithm really has a constant time complexity, and in certain cases it can outperform the widely used binary tree approach by 100 percent. The presented algorithm can be used to increase the performance of broadcasting, and can also indirectly speed up various group communication primitives used in standard message passing libraries.

show abstract

Section: Overview Of Broadcasting Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Asynchronous Distributed Broadcasting in Cluster Environment

Juhász

Kovács

2004

Recent Advances in Parallel Virtual Machine and Message Passing Interface

View full text Add to dashboard Cite

show abstract

“…GigaE-PM [22], PM/Ethernet [23], MESH [11], Bobnet [15], EMP [19], GAMMA [14] and U-NET [9] use Ethernet network. In these related works, MESH [11] and EMP [19] realize Zero-Copy communication by modifying firmware of NICs.…”

Section: Related Workmentioning

confidence: 99%

A scalable communication layer for multi-dimensional hyper crossbar network using multiple gigabit ethernet

Sumimoto

Ooe

Kumon

et al. 2006

Proceedings of the 20th Annual International Conference on Supercomputing

View full text Add to dashboard Cite

This paper proposes a scalable communication layer for a multi-dimensional hyper crossbar network using multiple Gigabit Ethernet for the PACS-CS system which consists of 2560 single-processor nodes and a 16 x 16 x 10 three dimensional hyper-crossbar network (3D-HXB). To realize a high performance communication layer using multiple existing Ethernet networks, the host processor usage for the communication processing must be reduced to less than the appropriate packet processing time which is calculated from a message size and a target communication bandwidth. To overcome this problem, we have developed the PM/Ethernet-HXB communication facility. PM/Ethernet-HXB realizes communication protocol processing without exclusion even for Zero-copy communication between the communication buffers of nodes. We have implemented the PM/Ethernet-HXB on SCore cluster system software, and evaluated its communication and application performance. PM/Ethernet-HXB achieves a unidirectional communication bandwidth of 1065 MB/s using nine Gigabit Ethernet links on a single dimension network. It also realizes a unidirectional communication bandwidth of 741 MB/s (98.8% of the theoretical performance) and a bidirectional bandwidth of 1401 MB/s (93.4% of the theoretical performance) on the three dimensional connections(3D-HXB: a total of six Ethernet links). The results of MPI communication bandwidth are a unidirectional communication bandwidth of 960 MB/s and a bidirectional bandwidth of 1008 MB/s using eight links on a single dimension network. These results show that PM/Ethernet-HXB realizes a comparative performance using multiple Gigabit Ethernet networks to dedicated cluster networks such as InfiniBand 4x (1000 MB/s). The speedups of IS and CG Class C NAS parallel benchmarks are scalable up to using four links on eight node cluster, and performance degradation between 3D-HXB (2 x 2 x 2) and 1-dimensional network is small.

show abstract

“…Entretanto, a grande maioria dos trabalhos utiliza apenas os termos NOW (YANG et al, 2003;KARATZA;HILZER, 2003;SHIM, 2004) e COW (CHIOLA; CIACCIO, 2000;ZHANG et al, 2000;ZHANG et al, 2001;KARATZA, 2002a).…”

Section: Clusters E Nowsunclassified

Um estudo comparativo de cargas de trabalho e políticas de escalonamento para aplicações paralelas em clusters e grids computacionais

Oliveira¹

View full text Add to dashboard Cite

Efficient parallel processing on low-cost clusters with GAMMA active ports

Cited by 22 publications

References 13 publications

Asynchronous Distributed Broadcasting in Cluster Environment

Asynchronous Distributed Broadcasting in Cluster Environment

A scalable communication layer for multi-dimensional hyper crossbar network using multiple gigabit ethernet

Um estudo comparativo de cargas de trabalho e políticas de escalonamento para aplicações paralelas em clusters e grids computacionais

Contact Info

Product

Resources

About