Deep MR Brain Image Super-Resolution Using Spatio-Structural Priors

Abstract

High resolution Magnetic Resonance (MR) images are desired for accurate diagnostics. In practice, image resolution is restricted by factors like hardware and processing constraints. Recently, deep learning methods have been shown to produce compelling state-of-the-art results for image enhancement/superresolution. Paying particular attention to desired hi-resolution MR image structure, we propose a new regularized network that exploits image priors, namely a low-rank structure and a sharpness prior to enhance deep MR image super-resolution (SR). Our contributions are then incorporating these priors in an analytically tractable fashion as well as towards a novel prior guided network architecture that accomplishes the superresolution task. This is particularly challenging for the low rank prior since the rank is not a differentiable function of the image matrix (and hence the network parameters), an issue we address by pursuing differentiable approximations of the rank. Sharpness is emphasized by the variance of the Laplacian which we show can be implemented by a fixed feedback layer at the output of the network. As a key extension, we modify the fixed feedback (Laplacian) layer by learning a new set of training data driven filters that are optimized for enhanced sharpness. Experiments performed on publicly available MR brain image databases and comparisons against existing state-of-the-art methods show that the proposed prior guided network offers significant practical gains in terms of improved SNR/image quality measures. Because our priors are on output images, the proposed method is versatile and can be combined with a wide variety of existing network architectures to further enhance their performance.

Fast and High-Resolution Neonatal Brain MRI Through Super-Resolution Reconstruction From Acquisitions With Variable Slice Selection Direction

“…Learning-based SRR summarizes the patterns mapping between LR and HR images over HR training data sets. Deep learning-based SRR has recently gained significant interest (Chaudhari et al, 2018 ; Chen et al, 2018 ; Zhao et al, 2019 ; Cherukuri et al, 2020 ; Wang et al, 2020 ; Xue et al, 2020 ). However, these methods require a large number of HR MRI acquisitions as the training data sets to learn the SRR model.…”

Denoising of 3D Brain MR Images with Parallel Residual Learning of Convolutional Neural Network Using Global and Local Feature Extraction

“…Zhang et al exploited denoising convolutional neural networks (DnCNNs) for Gaussian noise removal and achieved excellent performance by using residual learning strategy [ 20 ]. Cherukuri et al applied a deep learning network that leveraged the prior spatial structure of images to reconstruct high-resolution images [ 21 ]. Manjo′n et al proposed a novel automatic MR image denoising method by combining a convolutional neural network (CNN) with a traditional filter [ 22 ].…”

Assessing the Utility of Low Resolution Brain Imaging: Treatment of Infant Hydrocephalus

“…Learning-based methods have the advantage of modeling and learning the mapping of low-quality images to high-quality images from data alone [24][25][26][27]. Recently, deep learning has shown impressive performance in the field of super-resolution of MRI [28][29][30][31][32].…”