Improved nonparametric estimation of the optimal diagnostic cut‐off point associated with the Youden index under different sampling schemes

Abstract

A diagnostic cut-off point of a biomarker measurement is needed for classifying a random subject to be either diseased or healthy. However, the cut-off point is usually unknown and needs to be estimated by some optimization criteria. One important criterion is the Youden index, which has been widely adopted in practice. The Youden index, which is defined as the maximum of (sensitivity + specificity -1), directly measures the largest total diagnostic accuracy a biomarker can achieve. Therefore, it is desirable to estimate the optimal cut-off point associated with the Youden index. Sometimes, taking the actual measurements of a biomarker is very difficult and expensive, while ranking them without the actual measurement can be relatively easy. In such cases, ranked set sampling can give more precise estimation than simple random sampling, as ranked set samples are more likely to span the full range of the population. In this study, kernel density estimation is utilized to numerically solve for an estimate of the optimal cut-off point. The asymptotic distributions of the kernel estimators based on two sampling schemes are derived analytically and we prove that the estimators based on ranked set sampling are relatively more efficient than that of simple random sampling and both estimators are asymptotically unbiased. Furthermore, the asymptotic confidence intervals are derived. Intensive simulations are carried out to compare the proposed method using ranked set sampling with simple random sampling, with the proposed method outperforming simple random sampling in all cases. A real data set is analyzed for illustrating the proposed method.

The value of the Prognostic Nutritional Index (PNI) in predicting outcomes and guiding the treatment strategy of nasopharyngeal carcinoma (NPC) patients receiving intensity-modulated radiotherapy (IMRT) with or without chemotherapy

“…In the training set, receiver operating characteristic (ROC) curve analysis was used to evaluate the sensitivity and specificity of the PNI for predicting locoregional recurrence, distant metastasis and death, and the Youden index was estimated to determine the optimal cutoff value of the PNI (Yin et al 2016). The testing set was then stratified according to the optimum cut-off value.…”

Increased neurogranin concentrations in cerebrospinal fluid of Alzheimer’s disease and in mild cognitive impairment due to AD

“…Patients diagnosed with AD fulfilled the dementia criteria of the Diagnostic and Statistical Manual of Mental Disorders, Third Edition, Revision, and the criteria for probable AD as defined by NINCDS-ADRDA 13 . We re-selected a cohort of the patients where we included 44 healthy control (CTRL), 86 mild cognitive impairment (MCI), 25 AD, 6 MDD subjects (see Table 1 for full biomarker and demographic characteristics) discriminated by using a cut off established by a ROC curve towards Aβ 1-42 (<390 pg/ml with a Se=64% and Spe=68% with a Youden index=0.97 14 ) and T-tau level (>84 pg/ml with a Se=68% and Spe=68% with a Youden Index=1 14 ). Applying this cut-off in the MCI group we observed a clear separation in two groups, according CSF biomarkers profile, one closer to the CTRL profile (MCI=50) and the other one closer to the AD profile (prodromal AD=36).…”

Homogeneity evaluation of mesenchymal stem cells based on electrotaxis analysis

“…Generally Youden index is used to evaluate biomarker levels in the investigation and diagnosis of disease. Disease diagnosis by biomarkers is dependent upon a correlation between biomarker levels and disease state, whereby biomarker levels for a certain diseased population are different–usually higher–than in the corresponding non-diseased population 32 , 33 . Figure 2 showed the more osteogenic differentiation progressed, the more migration-speed decreased so stem cell homogeneity is dependent upon a correlation between migration speed and osteogenic differentiation state.…”