Circulating tumor DNA (ctDNA) sequencing is being rapidly adopted in precision oncology, but the accuracy, sensitivity, and reproducibility of ctDNA assays is poorly understood. Here we report the findings of a multi-site, cross-platform evaluation of the analytical performance of five industry-leading ctDNA assays. We evaluated each stage of the ctDNA sequencing workflow with simulations, synthetic DNA spike-in experiments, and proficiency testing on standardized cell line–derived reference samples. Above 0.5% variant allele frequency, ctDNA mutations were detected with high sensitivity, precision and reproducibility by all five assays, whereas below this limit detection became unreliable and varied widely between assays, especially when input material was limited. Missed mutations (false-negatives) were more common than erroneous candidates (false-positives), indicating that the reliable sampling of rare ctDNA fragments is the key challenge for ctDNA assays. This comprehensive evaluation of the analytical performance of ctDNA assays serves to inform best-practice guidelines and provides a resource for precision oncology.

Clinical applications of precision oncology require accurate tests that can distinguish true cancer specific mutations from errors introduced at each step of next-generation sequencing (NGS). To date, no bulk sequencing study has addressed the effects of cross-site reproducibility, nor the biological, technical and computational factors that influence variant identification. Here we report a systematic interrogation of somatic mutations in paired tumor-normal cell lines to identify factors affecting detection reproducibility and accuracy at six different centers. Using whole genome sequencing (WGS) and whole-exome sequencing (WES), we evaluated the reproducibility of different sample types with varying input amount and tumor purity, and multiple library construction protocols, followed by processing with nine bioinformatics pipelines. We found that read coverage and callers affected both WGS and WES reproducibility, but WES performance was influenced by insert fragment size, genomic copy content and the global imbalance score (GIV; G > T/C > A). Finally, taking into account library preparation protocol, tumor content, read coverage and bioinformatics processes concomitantly, we recommend actionable practices to improve the reproducibility and accuracy of NGS experiments for cancer mutation detection.

No abstract

Leukemia stem cells (LSC) are linked to relapse in acute myeloid leukemia (AML). The LSC17 gene expression score robustly captures LSC stemness properties in AML and can be used to predict survival outcomes and response to therapy, enabling risk-adapted upfront treatment approaches. The LSC17 score was developed and validated in a research setting. To enable wide use of the LSC17 score in clinical decision-making, we established a Laboratory Developed Test (LDT) for the LSC17 score that can be deployed broadly in clinical molecular diagnostic laboratories. We extensively validated the LSC17 LDT in a College of American Pathologists/Clinical Laboratory Improvements Act (CAP/CLIA)-certified laboratory, determining specimen requirements, a synthetic control, and performance parameters for the assay. Importantly, we correlated values from the LSC17 LDT to clinical outcome for a reference cohort of AML patients, establishing a median assay value that can be used for clinical risk stratification of individual patients with newly-diagnosed AML. The assay was established in a second independent CAP/CLIA-certified laboratory and its technical performance validated using an independent cohort of AML patient samples, demonstrating that the LSC17 LDT can be readily implemented in other settings. This study enables the clinical use of the LSC17 score for upfront risk-adapted management of AML patients.

No abstract