Accelerating genomic workflows using NVIDIA Parabricks

Abstract

BackgroundAs genome sequencing becomes a more integral part of scientific research, government policy, and personalized medicine, the primary challenge for researchers is shifting from generating raw data to analyzing these vast datasets. Although much work has been done to reduce compute times using various configurations of traditional CPU computing infrastructures, Graphics Processing Units (GPUs) offer the opportunity to accelerate genomic workflows by several orders of magnitude. Here we benchmark one GPU-accelerated software suite called NVIDIA Parabricks on Amazon Web Services (AWS), Google Cloud Platform (GCP), and an NVIDIA DGX cluster. We benchmarked six variant calling pipelines, including two germline callers (HaplotypeCaller and DeepVariant) and four somatic callers (Mutect2, Muse, LoFreq, SomaticSniper).ResultsFor germline callers, we achieved up to 65x acceleration, bringing HaplotypeCaller runtime down from 36 hours to 33 minutes on AWS, 35 minutes on GCP, and 24 minutes on the NVIDIA DGX. Somatic callers exhibited more variation between the number of GPUs and computing platforms. On cloud platforms, GPU-accelerated germline callers resulted in cost savings compared with CPU runs, whereas somatic callers were often more expensive than CPU runs because their GPU acceleration was not sufficient to overcome the increased GPU cost.ConclusionsGermline variant callers scaled with the number of GPUs across platforms, whereas somatic variant callers exhibited more variation in the number of GPUs with the fastest runtimes, suggesting that these workflows are less GPU optimized and require benchmarking on the platform of choice before being deployed at production scales. Our study demonstrates that GPUs can be used to greatly accelerate genomic workflows, thus bringing closer to grasp urgent societal advances in the areas of biosurveillance and personalized medicine.

Versatile, accessible cross-platform molecular profiling of central nervous system tumors: web-based, prospective multi-center validation

“…An updated Nextflow pipeline compatible with latest version tools as available in March 2024 is also made available. In this pipeline, GPUsupported variant calling is performed using Clara Parabricks 44 . The pipelines are made available on Github.…”

Biostatistical Aspects of Whole Genome Sequencing Studies: Preprocessing and Quality Control

“…2020a). Alternative approaches for data preprocessing have been developed, such as the GPU‐based NVIDIA Parabricks (O'Connell, Yosufzai, and Campbell 2022). Another major hardware improvement is related to the CPU‐based systems.…”

“…For example, while the preprocessing of a single WGS sample from the FASTQ file to the GVCF took several hours on a well-equipped CPU-based system a decade ago, it requires <30 min on an FPGA-based computer (Betschart et al 2022;Zhao et al 2020a). Alternative approaches for data preprocessing have been developed, such as the GPU-based NVIDIA Parabricks (O'Connell, Yosufzai, and Campbell 2022). Another major hardware improvement is related to the CPU-based systems.…”

Cutting-Edge AI Technologies Meet Precision Medicine to Improve Cancer Care

“…For germline callers, the author observed speedups of up to 65× (GATK haplotype caller). Alternatively, somatic variant callers achieved speedups of up to 56.8× (Mutect2 algorithm) [ 81 ]. For emergency use for hospitalized patients, Clark et al built a pipeline based on the DRAGEN platform to analyze genome sequencing data.…”