HPC Environment Management: New Challenges in the Petaflop Era

Abstract

Abstract. High Performance Computing (HPC) is becoming much more popular nowadays. Currently, the biggest supercomputers in the world have hundreds of thousands of processors and consequently may have more software and hardware failures. HPC centers managers also have to deal with multiple clusters from different vendors with their particular architectures. However, since there are not enough HPC experts to manage all the new supercomputers, it is expected that non-experts will be managing those large clusters. In this paper we study the new challenges to manage HPC environments containing different clusters with different sizes and architectures. We review available tools and present LEMMing [1], an easy-to-use open source tool developed to support high performance computing centers. LEMMing integrates machine resources and the available management and monitoring tools on a single point of management.

Improving Many-Task computing in scientific workflows using P2P techniques

“…For example, what are the winners approaches to deal with the dynamic behavior of computing nodes inside huge clusters? This issue is important since the number of cores per cluster is growing fast and, even with better machinery, as the number of electronic components increases, greater is the chance of a failure [16].…”