Toward a Generic Hybrid CPU-GPU Parallelization of Divide-and-Conquer Algorithms

Abstract

In the last few years, the development of programming languages for general purpose computing on Graphic Processing Units (GPUs) has led to the design and implementation of fast parallel algorithms for this architecture for a large spectrum of applications. Given the streaming-processing characteristics of GPUs, most practical applications consist of tasks that admit highly data-parallel algorithms. Many problems, however, allow for task-parallel solutions or a combination of task and data-parallel algorithms. For these, a hybrid CPU-GPU parallel algorithm that combines the highly parallel stream-processing power of GPUs with the higher scalar power of multi-cores is likely to be superior. In this paper we describe a generic translation of any recursive sequential implementation of a divide-and-conquer algorithm into an implementation that benefits from running in parallel in both multi-cores and GPUs. This translation is generic in the sense that it requires little knowledge of the particular algorithm. We then present a schedule and work division scheme that adapts to the characteristics of each algorithm and the underlying architecture, efficiently balancing the workload between GPU and CPU. Our experiments show a 4.5x speedup over a single core recursive implementation, while demonstrating the accuracy and practicality of the approach.

Efficient CPU‐GPU cooperative computing for solving the subset‐sum problem

“…The CPU‐GPU cooperative computing has recently attracted the attention of many researchers and application developers. Some applications have been reported to successfully implement the CPU‐GPU cooperative computing, instead of the CPU‐only or GPU‐only computing, such as matrix multiplication , fast Fourier transformation , LU factorization , QR factorization , unsymmetric sparse linear system , radiation physics , molecular dynamics , conjugate gradient method , divide‐and‐conquer algorithm , and branch‐and‐bound algorithm . These works show that the CPU‐GPU cooperative computing has much better performance than the CPU‐only or GPU‐only computing.…”