Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities

Abstract

The anatomical location of imaging features is of crucial importance for accurate diagnosis in many medical tasks. Convolutional neural networks (CNN) have had huge successes in computer vision, but they lack the natural ability to incorporate the anatomical location in their decision making process, hindering success in some medical image analysis tasks. In this paper, to integrate the anatomical location information into the network, we propose several deep CNN architectures that consider multi-scale patches or take explicit location features while training. We apply and compare the proposed architectures for segmentation of white matter hyperintensities in brain MR images on a large dataset. As a result, we observe that the CNNs that incorporate location information substantially outperform a conventional segmentation method with handcrafted features as well as CNNs that do not integrate location information. On a test set of 50 scans, the best configuration of our networks obtained a Dice score of 0.792, compared to 0.805 for an independent human observer. Performance levels of the machine and the independent human observer were not statistically significantly different (p-value = 0.06).

Classification of clinical significance of MRI prostate findings using 3D convolutional neural networks

“…Similar to the work of Ghafoorian et al, 8 we added explicit zone information to the first dense layer. The DCE-MRI and DWI streams with input sizes of (32 × 32 × 12) had 9 convolutional layers combining of (3 × 3 × 1) and (3 × 3 × 3) filter sizes.…”

Artificial intelligence in radiology

“…Studies have also shown that deep learning technologies are on par with radiologists’ performance for both detection 36 and segmentation 37 tasks in ultrasonography and MRI, respectively. For the classification tasks of lymph node metastasis in PET-CT, deep learning had higher sensitivities but lower specificities than radiologists 38 .…”

Deep Learning for Medical Image Analysis: Applications to Computed Tomography and Magnetic Resonance Imaging

“…Beside these topics, there are many other examples: a methodology to estimate the uncertainty of the prediction that artificial intelligence model generates; principled way to integrate clinical or medical knowledge into the model training; development of content-based case retrieval system that searches images of similar diseases or conditions; efficient analysis of higherdimensional medical image, such as contrast enhanced images or follow-up images; and research on the privacy and security related to medical images when training and implementing artificial intelligence models [28,43,44,45,46]. These topics have not been thoroughly studied, and larger-scale studies are required.…”

“…In a study done by Ghafoorian et al, a network architecture based on multi-scale T1 and FLAIR MR patches was proposed to segment and quantify white matter hyperintensities, which are related to various brain disorders [28]. When they compared various structures that combine data from multiple scales, the multi-scale late fusion with weight sharing (MSWS) structure, which shares the CNN feature extraction weights and fuses the features for the final segmentation, showed the best performance.…”