General‐purpose computation on GPUs for high performance cloud computing

Abstract

SUMMARY Cloud computing is offering new approaches for High Performance Computing (HPC) as it provides dynamically scalable resources as a service over the Internet. In addition, General‐Purpose computation on Graphical Processing Units (GPGPU) has gained much attention from scientific computing in multiple domains, thus becoming an important programming model in HPC. Compute Unified Device Architecture (CUDA) has been established as a popular programming model for GPGPUs, removing the need for using the graphics APIs for computing applications. Open Computing Language (OpenCL) is an emerging alternative not only for GPGPU but also for any parallel architecture. GPU clusters, usually programmed with a hybrid parallel paradigm mixing Message Passing Interface (MPI) with CUDA/OpenCL, are currently gaining high popularity. Therefore, cloud providers are deploying clusters with multiple GPUs per node and high‐speed network interconnects in order to make them a feasible option for HPC as a Service (HPCaaS). This paper evaluates GPGPU for high performance cloud computing on a public cloud computing infrastructure, Amazon EC2 Cluster GPU Instances (CGI), equipped with NVIDIA Tesla GPUs and a 10 Gigabit Ethernet network. The analysis of the results, obtained using up to 64 GPUs and 256‐processor cores, has shown that GPGPU is a viable option for high performance cloud computing despite the significant impact that virtualized environments still have on network overhead, which still hampers the adoption of GPGPU communication‐intensive applications. Copyright © 2012 John Wiley & Sons, Ltd.

Evaluation of Java for General Purpose GPU Computing

“…Moreover, jCuda is based on CUDA whereas Aparapi relies on OpenCL, but this fact is not especially relevant. A previous work [14] on the evaluation of CUDA and OpenCL, on the experimental testbed used for the performance evaluation presented in this section, has shown that CUDA and OpenCL are able to provide roughly the same performance, therefore the actual implementation of a given code is the main reason of performance differences among CUDA and OpenCL.…”

Performance Analysis and Modeling of Video Transcoding Using Heterogeneous Cloud Services

“…• GPU Optimized VMs: The GPU-Optimized VMs are applied for compute-intensive tasks (i.e., tasks that involve huge mathematical operations). Many large-scale simulations, such as computational chemistry, rendering, and financial analysis are conducted on GPU-Optimized VMs [34]. • Storage Optimized and Dense Storage VMs: These VM types are utilized in cases where low storage cost and high data density is necessary.…”

Cloud scalability: building the Millennium Falcon

“…Running general-purpose computation on graphic processing units as a mechanism to expand current vessel capabilities is the aim of the work by Expósito et al [21]. This is a revolutionary approach within the classic vertical scalability approach in conventional data centers.…”