Ultrasound Image Generation and Modality Conversion Based on Deep Learning

Abstract

Artificial intelligent (AI) based on deep learning has been used in medical imaging analysis for years. Improvements have been made in the diagnosis of various diseases with the help of deep learning. Multimodal medical imaging combines two or more imaging modalities, providing comprehensive diagnostic information of the diseases. However, some modality problems always exist in clinical practice. Recently, AI-based deep learning technologies have realized the modality conversion.Investigations on modality conversion have gradually been reported in order to acquire multimodal information. MRI images could be generated from CT images while ultrasound elastography could be generated from B mode ultrasonography. Continuous researches and development of new technologies around deep learning are still under investigation and provide huge clinical potentials in the future. The purpose of this review is to summarize an overview of the current applications and prospects of deep learning-based modality conversion of medical imaging.