Towards highly available and scalable high performance clusters

Abstract

In recent years, we have witnessed a growing interest in high performance computing (HPC) using a cluster of workstations. This growth made it affordable to individuals to have exclusive access to their own supercomputers. However, one of the challenges in a clustered environment is to keep system failure to the minimum and to achieve the highest possible level of system availability. High-Availability (HA) computing attempts to avoid the problems of unexpected failures through active redundancy and preemptive measures. Since the price of hardware components are significantly dropping, we propose to combine both HPC and HA concepts and layout the design of a HA-HPC cluster, considering all possible measures. In particular, we explore the hardware and the management layers of the HA-HPC cluster design, as well as a more focused study on the parallel-applications layer (i.e. FT-MPI implementations). Our findings show that combining HPC and HA architectures is feasible, in order to achieve HA cluster that is used for High Performance Computing.

Distributed computing and data storage in proteomics: Many hands make light work, and a stronger memory

“…Perhaps the best known architecture for parallel computing using off‐the‐shelf computers is GRID computing. The term itself was first used in the early 90s, as an analogy to the power grid , but where a traditional power grid allows a user to plug in and acquire electrical power at will, a computational GRID is designed to deliver CPU time and processing capacity upon request. In principle, cluster‐ and GRID‐based systems are very similar, with the former essentially a simplified version of the latter .…”