Although the receiver operating characteristic (ROC) paradigm is the accepted method for evaluation of diagnostic imaging systems, it has some serious shortcomings inasmuch as it is restricted to one observer report per image. By contrast the free-response ROC (FROC) paradigm and associated analysis method allows the observer to report multiple abnormalities within each imaging study, and uses the location of reported abnormalities to improve the measurement. Because the ROC method cannot accommodate multiple responses or use location information, its statistical power will suffer. The FROC paradigm/analysis has not enjoyed widespread acceptance because of concern about whether responses made to the same diagnostic study can be treated as independent. We propose a new jackknife FROC analysis method (JAFROC) that does not make the independence assumption. The new analysis method combines elements of FROC and the Dorfman-Berbaum-Metz (DBM) methods. To compare JAFROC to an earlier free-response analysis method (specifically the alternative free-response, or AFROC method), and to the DBM method, which uses conventional ROC scoring, we developed a model for generating simulated FROC data. The simulation model is based on an eye-movement model of how experts evaluate images. It allowed us to examine null hypothesis (NH) behavior and statistical power of the different methods. We found that AFROC analysis did not pass the NH test, being unduly conservative. Both the JAFROC method and the DBM method passed the NH test, but JAFROC had more statistical power than the DBM method. The results of this comparison suggest that future studies of diagnostic performance may enjoy improved statistical power or reduced sample size requirements through the use of the JAFROC method.
Medical procedures in outpatient settings have limited options of managing pain and anxiety pharmacologically. We therefore assessed whether this can be achieved by adjunct self-hypnotic relaxation in a common and particularly anxiety provoking procedure. Two hundred and thirty-six women referred for large core needle breast biopsy to an urban tertiary university-affiliated medical center were prospectively randomized to receive standard care (n=76), structured empathic attention (n=82), or self-hypnotic relaxation (n=78) during their procedures. Patients' self-ratings at 1 min-intervals of pain and anxiety on 0-10 verbal analog scales with 0=no pain/anxiety at all, 10=worst pain/anxiety possible, were compared in an ordinal logistic regression model. Women's anxiety increased significantly in the standard group (logit slope=0.18, p<0.001), did not change in the empathy group (slope=-0.04, p=0.45), and decreased significantly in the hypnosis group (slope=-0.27, p<0.001). Pain increased significantly in all three groups (logit slopes: standard care=0.53, empathy=0.37, hypnosis=0.34; all p<0.001) though less steeply with hypnosis and empathy than standard care (p=0.024 and p=0.018, respectively). Room time and cost were not significantly different in an univariate ANOVA despite hypnosis and empathy requiring an additional professional: 46 min/161 dollars for standard care, 43 min/163 dollars for empathy, and 39 min/152 dollars for hypnosis. We conclude that, while both structured empathy and hypnosis decrease procedural pain and anxiety, hypnosis provides more powerful anxiety relief without undue cost and thus appears attractive for outpatient pain management.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.