Deep learning attempts medical image denoising either by directly learning the noise present or via first learning the image content. We observe that residual learning (RL) often suffers from signal leakage while dictionary learning (DL) is prone to Gibbs (ringing) artifacts. In this paper, we propose an unsupervised noise learning framework that enhances denoising by augmenting the limitation of RL with the strength of DL and vice versa. To this end, we propose a ten-layer deep residue network (DRN) augmented with patch-based dictionaries. The input images are presented to patch-based DL to indirectly learn the noise via sparse representation while given to the DRN to directly learn the noise. An optimum noise characterization is captured by iterating DL/DRN network against proposed loss. The denoised images are obtained by subtracting the learned noise from available data. We show that augmented DRN effectively handles high-frequency regions to avoid Gibbs artifacts due to DL while augmented DL helps to reduce the overfitting due to RL. Comparative experiments with many state-of-the-arts on MRI and CT datasets (2D/3D) including low-dose CT (LDCT) are conducted on a GPU-based supercomputer. The ablation studies are carried out that demonstrate enhanced denoising performance with minimal signal leakage and least artifacts by proposed augmented approach.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.