Digital and conventional chest imaging: a modified ROC study of observer performance using simulated nodules.

Chakraborty, Dev P.; Breatnach, E; Yester, Michael V.; Soto, Benigno; Barnes, G.T; Fraser, Robert G.

doi:10.1148/radiology.158.1.3940394

Cited by 85 publications

(31 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…To compare the diagnostic performance of UTE and MR angiography in the detection of PE, alternative free-response receiver operating characteristic curve (AFROC) analysis was performed (26)(27)(28)(29)(30). AFROC is a modified receiver operating characteristic curve technique that allows multiple responses and incorporates the location of lesions (28,30).…”

Section: Statistical Analysesmentioning

confidence: 99%

Pulmonary Embolism Detection with Three-dimensional Ultrashort Echo Time MR Imaging: Experimental Study in Canines

Bannas¹,

Bell²,

Johnson³

et al. 2016

Radiology

View full text Add to dashboard Cite

q RSNA, 2015 Purpose:To demonstrate the feasibility of free-breathing three-dimensional (3D) radial ultrashort echo time (UTE) magnetic resonance (MR) imaging in the simultaneous detection of pulmonary embolism (PE) and high-quality evaluation of lung parenchyma. Materials andMethods:The institutional animal care committee approved this study. A total of 12 beagles underwent MR imaging and computed tomography (CT) before and after induction of PE with autologous clots. Breath-hold 3D MR angiography and freebreathing 3D radial UTE (1.0-mm isotropic spatial resolution; echo time, 0.08 msec) were performed at 3 T. Two blinded radiologists independently marked and graded all PEs on a four-point scale (1 = low confidence, 4 = absolutely certain) on MR angiographic and UTE images. Image quality of pulmonary arteries and lung parenchyma was scored on a four-point-scale (1 = poor, 4 = excellent). Locations and ratings of emboli were compared with reference standard CT images by using an alternative free-response receiver operating characteristic curve (AFROC) method. Areas under the curve and image quality ratings were compared by using the F test and the Wilcoxon signed-rank test. Results:A total of 48 emboli were detected with CT. Both readers showed higher sensitivity for PE detection with UTE (83% and 79%) than with MR angiography (75% and 71%). The AFROC area under the curve was higher for UTE than for MR angiography (0.95 vs 0.89), with a significant difference in area under the curve of 0.06 (95% confidence interval: 0.01, 0.11; P = .018). UTE image quality exceeded that of MR angiography for subsegmental arteries (3.5 6 0.7 vs 2.9 6 0.5, P = .002) and lung parenchyma (3.8 6 0.5 vs 2.2 6 0.2, P , .001). The apparent signal-to-noise ratio in pulmonary arteries and lung parenchyma was significantly higher for UTE than for MR angiography (41.0 6 5.2 vs 24.5 6 6.2 [P , .001] and 10.2 6 1.8 vs 3.5 6 0.8 [P , .001], respectively). The apparent contrast-to-noise ratio between arteries and PEs was higher for UTE than for MR angiography (20.3 6 5.2 vs 15.4 6 6.7, P = .055). Conclusion:In a canine model, free-breathing 3D radial UTE performs better than breath-hold 3D MR angiography in the detection of PE and yields better image quality for visualization of small vessels and lung parenchyma. Free-breathing 3D radial UTE for detection of PE is feasible and warrants evaluation in human subjects.q RSNA, 2015

show abstract

Section: Statistical Analysesmentioning

confidence: 99%

Pulmonary Embolism Detection with Three-dimensional Ultrashort Echo Time MR Imaging: Experimental Study in Canines

Bannas¹,

Bell²,

Johnson³

et al. 2016

Radiology

View full text Add to dashboard Cite

show abstract

“…A generalization of LROC in which the location of multiple signals is determined is free-response operating characteristic analysis, FROC (Bunch et al, 1978). Extensions of FROC analysis are alternative free-response operating characteristic, AFROC, and free-response forced error, FFE, analyses (Chakraborty et al, 1986;Chakraborty, 1989;Chakraborty and Winter, 1990). These tests could be applied to evaluating an observer's (or a metho d s ) ability to correctly identify multiple lesions (such as enamel hypoplasias, porotic hyperostoses, and radiopaque transverse lines).…”

Section: Discussionmentioning

confidence: 99%

ROC analysis of observer‐response subjective rating data—application to periodontal radiograph assessment

Hildebolt

Vannier

Shrout

et al. 1991

American J Phys Anthropol

View full text Add to dashboard Cite

Many physical anthropological studies require that an observer or device discriminate between states that can be easily confused. Receiver operating characteristic (ROC) analysis currently offers the best method for determining the accuracy of such choices, particularly for small sample sizes. Although ROC analysis is widely accepted in psychophysical and biomedical testing, its use in anthropological studies has not been reported. ROC analysis is used here to determine the usefulness of enhanced dental radiographs to assess vertical alveolar bone defects for quantitative studies of human variation with regard to periodontal disease. The presence or absence of vertical-bony defects (truth) for 75 human skulls was established by the consensus of two trained observers. Dental bitewing-radiographs were taken of the alveolar processes, the radiographs digitized, and the brightness and contrast of the digital images enhanced. The two observers who established truth then rated 1) plain bitewing radiographs, 2) unenhanced digital images of bitewings, and 3) enhanced digital images of bitewings for vertical bony defects. The rating scale varied from 1 (vertical defect definitely or almost definitely present) to 5 (definitely or almost definitely absent). ROC analysis was used to compared the diagnostic value of the 3 imaging modalities. All modalities had nearly identical diagnostic performance, measured as Az values (areas beneath ROC curves) that were less than 0.80, which indicates only moderate usefulness. It is concluded that enhancement does not increase success in vertical-bony-defect diagnosis from digital dental radiographs processed in this manner. Moreover, it is suggested that conventional bitewing radiographs may be unsuitable for accurate quantification of such defects.

show abstract

“…The detection rate was evaluated by free-response receiver operating characteristic (FROC) analysis. [19][20][21][22] The number of false positives per image and the true-positive rate were evaluated using the island number at the time point of binarization processing of ANN output images by various threshold values.…”

Section: Evaluation Of Our Algorithmmentioning

confidence: 99%

Quantitative Kinetic Analysis of Lung Nodules Using the Temporal Subtraction Technique in Dynamic Chest Radiographies Performed with a Flat Panel Detector

et al. 2008

View full text Add to dashboard Cite

Early detection and treatment of lung cancer is one of the most effective means of reducing cancer mortality, and to this end, chest X-ray radiography has been widely used as a screening method. A related technique based on the development of computer analysis and a flat panel detector (FPD) has enabled the functional evaluation of respiratory kinetics in the chest and is expected to be introduced into clinical practice in the near future. In this study, we developed a computer analysis algorithm to detect lung nodules and to evaluate quantitative kinetics. Breathing chest radiographs obtained by modified FPD and breath synchronization utilizing diaphragmatic analysis of vector movement were converted into four static images by sequential temporal subtraction processing, morphological enhancement processing, kinetic visualization processing, and lung region detection processing. An artificial neural network analyzed these density patterns to detect the true nodules and draw their kinetic tracks. Both the algorithm performance and the evaluation of clinical effectiveness of seven normal patients and simulated nodules showed sufficient detecting capability and kinetic imaging function without significant differences. Our technique can quantitatively evaluate the kinetic range of nodules and is effective in detecting a nodule on a breathing chest radiograph. Moreover, the application of this technique is expected to extend computeraided diagnosis systems and facilitate the development of an automatic planning system for radiation therapy.

show abstract

Digital and conventional chest imaging: a modified ROC study of observer performance using simulated nodules.

Cited by 85 publications

References 0 publications

Pulmonary Embolism Detection with Three-dimensional Ultrashort Echo Time MR Imaging: Experimental Study in Canines

Pulmonary Embolism Detection with Three-dimensional Ultrashort Echo Time MR Imaging: Experimental Study in Canines

ROC analysis of observer‐response subjective rating data—application to periodontal radiograph assessment

Quantitative Kinetic Analysis of Lung Nodules Using the Temporal Subtraction Technique in Dynamic Chest Radiographies Performed with a Flat Panel Detector

Contact Info

Product

Resources

About