Dr. Top-k: Delegate-Centric Top-k on GPUs

Abstract

Recent top-𝑘 computation efforts explore the possibility of revising various sorting algorithms to answer top-𝑘 queries on GPUs. These endeavors, unfortunately, perform significantly more work than needed. This paper introduces Dr. Top-k, a Delegate-centric top-𝑘 system on GPUs that can reduce the top-𝑘 workloads significantly. Particularly, it contains three major contributions: First, we introduce a comprehensive design of the delegate-centric concept, including maximum delegate, delegate-based filtering, and 𝛽 delegate mechanisms to help reduce the workload for top-𝑘 up to more than 99%. Second, due to the difficulty and importance of deriving a proper subrange size, we perform a rigorous theoretical analysis, coupled with thorough experimental validations to identify the desirable subrange size. Third, we introduce four key system optimizations to enable fast multi-GPU top-𝑘 computation. Taken together, this work constantly outperforms the state-of-the-art.