A time‐dependent discrimination index for survival data

Abstract

To derive models suitable for outcome prediction, a crucial aspect is the availability of appropriate measures of predictive accuracy, which have to be usable for a general class of models. The Harrell's C discrimination index is an extension of the area under the ROC curve to the case of censored survival data, which owns a straightforward interpretability. For a model including covariates with time-dependent effects and/or time-dependent covariates, the original definition of C would require the prediction of individual failure times, which is not generally addressed in most clinical applications. Here we propose a time-dependent discrimination index Ctd where the whole predicted survival function is utilized as outcome prediction, and the ability to discriminate among subjects having different outcome is summarized over time. Ctd is based on a novel definition of concordance: a subject who developed the event should have a less predicted probability of surviving beyond his/her survival time than any subject who survived longer. The predicted survival function of a subject who developed the event is compared to: (1) that of subjects who developed the event before his/her survival time, and (2) that of subjects who developed the event, or were censored, after his/her survival time. Subjects who were censored are involved in comparisons with subjects who developed the event before their observed times. The index reduces to the previous C in the presence of separation between survival curves on the whole follow-up. A confidence interval for Ctd is derived using the jackknife method on correlated one-sample U-statistics.The proposed index is used to evaluate the discrimination ability of a model, including covariates having time-dependent effects, concerning time to relapse in breast cancer patients treated with adjuvant tamoxifen. The model was obtained from 596 patients entered prospectively at Istituto Nazionale per lo Studio e la Cura dei Tumori di Milano (INT). The model discrimination ability was validated on an independent testing data set of 175 patients provided by Centro Regionale Indicatori Biochimici di Tumore (CRIBT) in Venice.

The graft-versus-leukemia effect is mainly restricted to NIH-defined chronic graft-versus-host disease after reduced intensity conditioning before allogeneic stem cell transplantation

“…Patients were allowed to transition from one subtype to another, except patients with classic chronic GVHD could not transition back to overlap syndrome. The ability of the two GVHD classifications to predict NRM was compared using the discrimination index (c-index) for timedependent variables 13 and the model likelihood by Akaike's information criterion (AIC). 14 Briefly, AIC is a model-selection criterion penalized by the number of parameters in the model.…”

The Michigan Model for Coronary Heart Disease in Type 2 Diabetes: Development and Validation

“…Second, in order to use the model for long-term prediction, we used a nonlinear regression model to fit a Weibull cumulative hazard function to the estimated nonparametric cumulative baseline hazard function of the incident cohort derived from the Cox proportional hazard model. The 10-year C-index 52 We assumed that the combined effect of multiple medications was equal to the maximum of the individual medication effects.…”

Usefulness of the delta neutrophil index to predict 30-day mortality in patients with ST segment elevation myocardial infarction

“…To investigate the additional predictive power of the DNI at each time point, we calculated Harrell's C-index for each Cox regression model [37][38][39][40] . To calculate the 95% CIs and p-values for the C index and the differences between models, we used a standard bootstrap method with resampling 1,000 times 37 .…”