BackgroundCardiovascular resonance (CMR) imaging is a standard imaging modality for assessing cardiovascular diseases (CVDs), the leading cause of death globally. CMR enables accurate quantification of the cardiac chamber volume, ejection fraction and myocardial mass, providing information for diagnosis and monitoring of CVDs. However, for years, clinicians have been relying on manual approaches for CMR image analysis, which is time consuming and prone to subjective errors. It is a major clinical challenge to automatically derive quantitative and clinically relevant information from CMR images.MethodsDeep neural networks have shown a great potential in image pattern recognition and segmentation for a variety of tasks. Here we demonstrate an automated analysis method for CMR images, which is based on a fully convolutional network (FCN). The network is trained and evaluated on a large-scale dataset from the UK Biobank, consisting of 4,875 subjects with 93,500 pixelwise annotated images. The performance of the method has been evaluated using a number of technical metrics, including the Dice metric, mean contour distance and Hausdorff distance, as well as clinically relevant measures, including left ventricle (LV) end-diastolic volume (LVEDV) and end-systolic volume (LVESV), LV mass (LVM); right ventricle (RV) end-diastolic volume (RVEDV) and end-systolic volume (RVESV).ResultsBy combining FCN with a large-scale annotated dataset, the proposed automated method achieves a high performance in segmenting the LV and RV on short-axis CMR images and the left atrium (LA) and right atrium (RA) on long-axis CMR images. On a short-axis image test set of 600 subjects, it achieves an average Dice metric of 0.94 for the LV cavity, 0.88 for the LV myocardium and 0.90 for the RV cavity. The mean absolute difference between automated measurement and manual measurement is 6.1 mL for LVEDV, 5.3 mL for LVESV, 6.9 gram for LVM, 8.5 mL for RVEDV and 7.2 mL for RVESV. On long-axis image test sets, the average Dice metric is 0.93 for the LA cavity (2-chamber view), 0.95 for the LA cavity (4-chamber view) and 0.96 for the RA cavity (4-chamber view). The performance is comparable to human inter-observer variability.ConclusionsWe show that an automated method achieves a performance on par with human experts in analysing CMR images and deriving clinically relevant measures.Electronic supplementary materialThe online version of this article (10.1186/s12968-018-0471-x) contains supplementary material, which is available to authorized users.

Compressed sensing (CS) has been demonstrated to accelerate MRI acquisitions by reconstructing sparse images of good quality from highly undersampled data. Motion during MR scans can cause inconsistencies in k-space data, resulting in strong motion artifacts in the reconstructed images. For CS to be useful in these applications, motion correction techniques need to be combined with the undersampled reconstruction. Recently, joint motion correction and CS approaches have been proposed to partially correct for effects of motion. However, the main limitation of these approaches is that they can only correct for affine deformations. In this work, we propose a novel motion corrected CS framework for free-breathing dynamic cardiac MRI that incorporates a general motion correction formulation directly into the CS reconstruction. This framework can correct for arbitrary affine or nonrigid motion in the CS reconstructed cardiac images, while simultaneously benefiting from highly accelerated MR acquisition. The application of this approach is demonstrated both in simulations and in vivo data for 2D respiratory self-gated free-breathing cardiac CINE MRI, using a golden angle radial acquisition. Results show that this approach allows for the reconstruction of respiratory motion corrected cardiac CINE images with similar quality to breath-held acquisitions. Magn Reson Med 70:504-516, 2013. V C 2012 Wiley Periodicals, Inc.

Automatic detection of anatomical landmarks is an important step for a wide range of applications in medical image analysis. Manual annotation of landmarks is a tedious task and prone to observer errors. In this paper, we evaluate novel deep reinforcement learning (RL) strategies to train agents that can precisely and robustly localize target landmarks in medical scans. An artificial RL agent learns to identify the optimal path to the landmark by interacting with an environment, in our case 3D images. Furthermore, we investigate the use of fixed-and multiscale search strategies with novel hierarchical action steps in a coarse-to-fine manner. Several deep Q-network (DQN) architectures are evaluated for detecting multiple landmarks using three different medical imaging datasets: fetal head ultrasound (US), adult brain and cardiac magnetic resonance imaging (MRI).The performance of our agents surpasses state-of-the-art supervised and RL methods. Our experiments also show that multi-scale search strategies perform significantly better than fixed-scale agents in images with large field of view and noisy background such as in cardiac MRI. Moreover, the novel hierarchical steps can significantly speed up the searching process by a factor of 4 − 5 times.