Efficient Noninferiority Testing Procedures for Simultaneously Assessing Sensitivity and Specificity of Two Diagnostic Tests

Abstract

Sensitivity and specificity are often used to assess the performance of a diagnostic test with binary outcomes. Wald-type test statistics have been proposed for testing sensitivity and specificity individually. In the presence of a gold standard, simultaneous comparison between two diagnostic tests for noninferiority of sensitivity and specificity based on an asymptotic approach has been studied by Chen et al. (2003). However, the asymptotic approach may suffer from unsatisfactory type I error control as observed from many studies, especially in small to medium sample settings. In this paper, we compare three unconditional approaches for simultaneously testing sensitivity and specificity. They are approaches based on estimation, maximization, and a combination of estimation and maximization. Although the estimation approach does not guarantee type I error, it has satisfactory performance with regard to type I error control. The other two unconditional approaches are exact. The approach based on estimation and maximization is generally more powerful than the approach based on maximization.

Machine learning methods to predict amyloid positivity using domain scores from cognitive tests

“…The Matthews Correlation Coefficient (MCC) can be considered as an alternative of accuracy to assess the model performance. The MCC is equivalent to the Pearson correlation coefficient between actual and predicted amyloid status, with the range from − 1 (perfect misclassification) to 1 (perfect classification) 46 , 47 . The MCC is defined as The MCC is a reliable statistical measure, and it has a high score only if the prediction obtained good results in all of the four confusion matrix categories (high values of TP and TN, and low values of FN and FP) 48 .…”

Diagnostic Sensitivity of Blood and Urine Biochemical Markers in Patients with Osteochondrosis of the Lumbar Spine

“…Вступ. Дослідження діагностичної чутливості лабораторних та інструментальних показників є одним із способів об'єктивізації результатів обстеження пацієнтів, які використовуються у сучасній медицині, зокрема, травматології та ортопедії [1][2][3][4]. Багаточисельними дослідженнями було описано методики оцінки та клінічні результати діагностичних тестів для хворих із хронічною біллю у спині.…”