Perceived Sufficiency of Full-Field Digital Mammograms With and Without Irreversible Image Data Compression for Comparison with Next-Year Mammograms

IntroductionWe examined the design, analysis and reporting in multi-reader multi-case (MRMC) research studies using the area under the receiver-operating curve (ROC AUC) as a measure of diagnostic performance.MethodsWe performed a systematic literature review from 2005 to 2013 inclusive to identify a minimum 50 studies. Articles of diagnostic test accuracy in humans were identified via their citation of key methodological articles dealing with MRMC ROC AUC. Two researchers in consensus then extracted information from primary articles relating to study characteristics and design, methods for reporting study outcomes, model fitting, model assumptions, presentation of results, and interpretation of findings. Results were summarized and presented with a descriptive analysis.ResultsSixty-four full papers were retrieved from 475 identified citations and ultimately 49 articles describing 51 studies were reviewed and extracted. Radiological imaging was the index test in all. Most studies focused on lesion detection vs. characterization and used less than 10 readers. Only 6 (12%) studies trained readers in advance to use the confidence scale used to build the ROC curve. Overall, description of confidence scores, the ROC curve and its analysis was often incomplete. For example, 21 (41%) studies presented no ROC curve and only 3 (6%) described the distribution of confidence scores. Of 30 studies presenting curves, only 4 (13%) presented the data points underlying the curve, thereby allowing assessment of extrapolation. The mean change in AUC was 0.05 (−0.05 to 0.28). Non-significant change in AUC was attributed to underpowering rather than the diagnostic test failing to improve diagnostic accuracy.ConclusionsData reporting in MRMC studies using ROC AUC as an outcome measure is frequently incomplete, hampering understanding of methods and the reliability of results and study conclusions. Authors using this analysis should be encouraged to provide a full description of their methods and results.

show abstract

Evaluation of Lossy Data Compression in Primary Interpretation for Full-Field Digital Mammography

Kovacs¹,

Reicher²,

Grotts³

et al. 2015

American Journal of Roentgenology

View full text Add to dashboard Cite

OBJECTIVE. For full-field digital mammography (FFDM), federal regulations prohibit lossy data compression for primary reading and archiving, unlike all other medical images, where reading physicians can apply their professional judgment in implementing lossy compression. Faster image transfer, lower costs, and greater access to expert mammographers would result from development of a safe standard for primary interpretation and archive of lossy-compressed FFDM images. This investigation explores whether JPEG 2000 80:1 lossy data compression affects clinical accuracy in digital mammography. MATERIALS AND METHODS. Randomized FFDM cases (n = 194) were interpreted by six experienced mammographers with and without JPEG 2000 80:1 lossy compression applied. A cancer-enriched population was used, with just less than half of the cases (42%) containing subtle (< 1 cm) biopsy-proven cancerous lesions, and the remaining cases were negative as proven by 2-year follow-up. Data were analyzed using the jackknife alternative free-response ROC (JAFROC) method. RESULTS. The differences in reader performance between lossy-compressed and non-lossy-compressed images using lesion localization (0.660 vs 0.671), true-positive fraction (0.879 vs 0.879), and false-positive fraction (0.283 vs 0.271) were not statistically significant. There was no difference in the JAFROC figure of merit between lossy-compressed and non-lossy-compressed images, with a mean difference of -0.01 (95% CI, -0.03 to 0.01; F1,5 = 2.30; p = 0.189). CONCLUSION. These results suggest that primary interpretation of JPEG 2000 80:1 lossy-compressed FFDM images may be viable without degradation of clinical quality. Benefits would include lower storage costs, faster telemammography, and enhanced access to expert mammographers.

show abstract

Perceived Sufficiency of Full-Field Digital Mammograms With and Without Irreversible Image Data Compression for Comparison with Next-Year Mammograms

Cited by 3 publications

References 8 publications

A database for assessment of effect of lossy compression on digital mammograms

A database for assessment of effect of lossy compression on digital mammograms

Multi-Reader Multi-Case Studies Using the Area under the Receiver Operator Characteristic Curve as a Measure of Diagnostic Accuracy: Systematic Review with a Focus on Quality of Data Reporting

Evaluation of Lossy Data Compression in Primary Interpretation for Full-Field Digital Mammography

Contact Info

Product

Resources

About