ROC-ing along: Evaluation and interpretation of receiver operating characteristic curves

Carter, Jane; Pan, Jianmin; Shesh, N.; Galandiuk, Susan

doi:10.1016/j.surg.2015.12.029

Cited by 557 publications

(375 citation statements)

References 14 publications

Supporting

Mentioning

368

Contrasting

Unclassified

Order By: Relevance

“…Receiver operating characteristic (ROC) curves were constructed to evaluate the predictive power of transcript levels for diagnosis of B-cell ALL. The Youden Index was used to calculate optimal cutoff points for gene transcript levels in diagnosis of B-cell ALL [50]. Survival functions were estimated by the Kaplan-Meier method and compared by the log-rank test.…”

Section: Methodsmentioning

confidence: 99%

Cysteine and glycine-rich protein 2 (CSRP2) transcript levels correlate with leukemia relapse and leukemia-free survival in adults with B-cell acute lymphoblastic leukemia and normal cytogenetics

Wang

Gale

et al. 2017

Oncotarget

View full text Add to dashboard Cite

Relapse is the major cause of treatment-failure in adults with B-cell acute lymphoblastic leukemia (ALL) achieving complete remission after induction chemotherapy. Greater precision identifying persons likely to relapse is important. We did bio-informatics analyses of transcriptomic data to identify mRNA transcripts aberrantly-expressed in B-cell ALL. We selected 9 candidate genes for validation 7 of which proved significantly-associated with B-cell ALL. We next focused on function and clinical correlations of the cysteine and glycine-rich protein 2 (CSRP2). Quantitative real-time polymerase chain reaction (RT-qPCR) was used to examine gene transcript levels in bone marrow samples from 236 adults with B-cell ALL compared with samples from normals. CSRP2 was over-expressed in 228 out of 236 adults (97%) with newly-diagnosed B-cell ALL. A prognostic value was assessed in 168 subjects. In subjects with normal cytogenetics those with high CSRP2 transcript levels had a higher 5-year cumulative incidence of relapse (CIR) and worse relapse-free survival (RFS) compared with subjects with low transcript levels (56% [95% confidence interval, 53, 59%] vs. 19% [18, 20%]; P = 0.011 and 41% [17, 65%] vs. 80% [66–95%]; P = 0.007). In multivariate analyses a high CSRP2 transcript level was independently-associated with CIR (HR = 5.32 [1.64–17.28]; P = 0.005) and RFS (HR = 5.56 [1.87, 16.53]; P = 0.002). Functional analyses indicated CSRP2 promoted cell proliferation, cell-cycle progression, in vitro colony formation and cell migration ability. Abnormal CSRP2 expression was associated with resistance to chemotherapy; sensitivity was restored by down-regulating CSRP2 expression.

show abstract

Section: Methodsmentioning

confidence: 99%

Cysteine and glycine-rich protein 2 (CSRP2) transcript levels correlate with leukemia relapse and leukemia-free survival in adults with B-cell acute lymphoblastic leukemia and normal cytogenetics

Wang

Gale

et al. 2017

Oncotarget

View full text Add to dashboard Cite

show abstract

“…Variables with significant collinearity (| r | ≥ 0.20, p < 0.05) to other variables in the model were eliminated, and all remaining variables were entered into the regression equation. Models were compared by area under the receiver operating characteristic curve (AUROC) [13, 14]. AUROC for different models were compared as described by DeLong et al [15] using SAS (version 9.3, SAS Institute, Cary, NC).…”

Section: Methodsmentioning

confidence: 99%

Percutaneous cholecystostomy: prognostic factors and comparison to cholecystectomy

et al. 2017

View full text Add to dashboard Cite

Background Data regarding long-term outcomes following percutaneous cholecystostomy (PC) are limited, and comparisons to cholecystectomy (CCY) are lacking. We hypothesized that chronic disease burden would predict 1-year mortality following PC, and that outcomes following PC and CCY would be similar when controlling for preprocedural risk factors. Methods We performed a 10-year retrospective cohort analysis of patients with acute cholecystitis managed by PC (n = 114) or CCY (n = 234). Treatment response was assessed by systemic inflammatory response syndrome (SIRS) criteria at PC/CCY and 72 h later. Logistic regression identified predictors of 30-day and 1-year mortality following PC. PC and CCY patients were matched by age, Tokyo Guidelines (TG13) cholecystitis severity grade, and VASQIP calculator predicted mortality (n = 42/group). Results The presence of SIRS at 72 h following PC was associated with 30-day mortality [OR 8.9 (95% CI 2.6–30)]. SIRS at 72 h was present in and 21.4% of all PC patients, significantly higher than unmatched CCY patients (4.7%, p = 0.048). Independent predictors of 1-year mortality following PC were DNR status [19.7 (2.1–186)], disseminated cancer [7.5 (2.1–26)], and congestive heart failure [3.9 (1.4–11)]. PC patients with none of these risk factors had 17.9% 90-day mortality and no deaths after 90 days; late deaths continued to occur among patients with DNR, CHF, or disseminated cancer. At baseline, PC patients had greater acute and chronic disease burden than CCY patients. After matching, PC and CCY patients had similar age (69 vs. 70 years), TG13 grade (2.4 vs. 2.4), and predicted 30-day mortality (5.5 vs. 6.8%). Matched PC patients had higher 30-day mortality (14.3 vs. 2.4%, p = 0.109) and 180-day mortality (28.6 vs. 7.1%, p = 0.048). Conclusions Treatment response to PC predicted 30-day mortality; DNR status, and chronic diseases predicted 1-year mortality. Although the matching procedure did not eliminate selection bias, PC was associated with persistent systemic inflammation and higher long-term mortality than CCY.

show abstract

“…Similar to the training cohort, comparisons 1, 2 and 3 as described above, were generated using data from the single miRNA assays and receiver operating characteristic (ROC) curves constructed and area-under-the-curve (AUC) calculated. 18 …”

Section: Methodsmentioning

confidence: 99%

A Highly Predictive Model for Diagnosis of Colorectal Neoplasms Using Plasma MicroRNA

et al. 2016

Self Cite

View full text Add to dashboard Cite

OBJECTIVE(S) Develop a plasma-based microRNA (miRNA) diagnostic assay specific for colorectal neoplasms, building upon our prior work. BACKGROUND Colorectal neoplasms (colorectal cancer [CRC] and colorectal advanced adenoma [CAA]) frequently develop in individuals at ages when other common cancers also occur. Current screening methods lack sensitivity, specificity, and have poor patient compliance. METHODS Plasma was screened for 380 miRNAs using microfluidic array technology from a “Training” cohort of 60 patients, (10 each) control, CRC, CAA, breast (BC), pancreatic (PC) and lung (LC) cancer. We identified uniquely dysregulated miRNAs specific for colorectal neoplasia (p<0.05, false discovery rate: 5%, adjusted α=0.0038). These miRNAs were evaluated using single assays in a “Test” cohort of 120 patients. A mathematical model was developed to predict blinded sample identity in a 150 patient “Validation” cohort using repeat-sub-sampling validation of the testing dataset with 1000 iterations each to assess model detection accuracy. RESULTS Seven miRNAs (miR-21, miR-29c, miR-122, miR-192, miR-346, miR-372, miR-374a) were selected based upon p-value, area-under-the-curve (AUC), fold-change, and biological plausibility. AUC (±95% CI) for “Test” cohort comparisons were 0.91 (0.85-0.96), 0.79 (0.70-0.88) and 0.98 (0.96-1.0), respectively. Our mathematical model predicted blinded sample identity with 69-77% accuracy between all neoplasia and controls, 67-76% accuracy between colorectal neoplasia and other cancers, and 86-90% accuracy between colorectal cancer and colorectal adenoma. CONCLUSIONS Our plasma miRNA assay and prediction model differentiates colorectal neoplasia from patients with other neoplasms and from controls with higher sensitivity and specificity compared to current clinical standards.

show abstract

ROC-ing along: Evaluation and interpretation of receiver operating characteristic curves

Cited by 557 publications

References 14 publications

Cysteine and glycine-rich protein 2 (CSRP2) transcript levels correlate with leukemia relapse and leukemia-free survival in adults with B-cell acute lymphoblastic leukemia and normal cytogenetics

Cysteine and glycine-rich protein 2 (CSRP2) transcript levels correlate with leukemia relapse and leukemia-free survival in adults with B-cell acute lymphoblastic leukemia and normal cytogenetics

Percutaneous cholecystostomy: prognostic factors and comparison to cholecystectomy

A Highly Predictive Model for Diagnosis of Colorectal Neoplasms Using Plasma MicroRNA

Contact Info

Product

Resources

About