Transfer learning classification of suspicious lesions on breast ultrasound: is there room to avoid biopsies of benign lesions?

Abstract

Background Breast cancer (BC) is the most common malignancy in women and the second cause of cancer death. In recent years, there has been a strong development in artificial intelligence (AI) applications in medical imaging for several tasks. Our aim was to evaluate the potential of transfer learning with convolutional neural networks (CNNs) in discriminating suspicious breast lesions on ultrasound images. Methods Transfer learning performances of five different CNNs (Inception V3, Xception, Densenet121, VGG 16, and ResNet50) were evaluated on a public and on an institutional dataset (526 and 392 images, respectively), customizing the top layers for the specific task. Institutional images were contoured by an expert radiologist and processed to feed the CNNs for training and testing. Postimaging biopsies were used as a reference standard for classification. The area under the receiver operating curve (AUROC) was used to assess diagnostic performance. Results Networks performed very well on the public dataset (AUROC 0.938–0.996). The direct generalization to the institutional dataset resulted in lower performances (max AUROC 0.676); however, when tested on BI-RADS 3 and BI-RADS 5 only, results were improved (max AUROC 0.792). Good results were achieved on the institutional dataset (AUROC 0.759–0.818) and, when selecting a threshold of 2% for classification, a sensitivity of 0.983 was obtained for three of five CNNs, with the potential to spare biopsy in 15.3%–18.6% of patients. Conclusion In conclusion, transfer learning with CNNs may achieve high sensitivity and might be used as a support tool in managing suspicious breast lesions on ultrasound images. Relevance statement Transfer learning is a powerful technique to exploit the performances of well-trained CNNs for image classification. In a clinical scenario, it might be useful for the management of suspicious breast lesions on breast ultrasound, potentially sparing biopsy in a non-negligible number of patients. Key Points Properly trained CNNs with transfer learning are highly effective in differentiating benign and malignant lesions on breast ultrasound. Setting clinical thresholds increased sensitivity. CNNs might be useful as support tools in managing suspicious lesions on breast ultrasound. Graphical Abstract