In this paper we present a benchmarking framework for the validation of cardiac motion analysis algorithms. The reported methods are the response to an open challenge that was put to the medical imaging community through a MICCAI workshop. The database included magnetic resonance (MR) and 3D ultrasound (3DUS) datasets from a dynamic phantom and 15 healthy volunteers. Participants processed 3D tagged MR datasets (3DTAG), cine steady state free precession MR datasets (SSFP) and 3DUS datasets, amounting to 1158 image volumes. Ground-truth for motion tracking was based on 12 landmarks (4 walls at 3 ventricular levels). They were manually tracked by two observers in the 3DTAG data over the whole cardiac cycle, using an in-house application with 4D visualization capabilities. The median of the inter-observer variability was computed for the phantom dataset (0.77mm) and for the volunteer datasets (0.84mm). The ground-truth was registered to 3DUS coordinates using a point based similarity transform. Four institutions responded to the challenge by providing motion estimates for the data: Fraunhofer MEVIS (MEVIS), Bremen, Germany; Imperial College London -University College London (IUCL), UK; Universitat Pompeu Fabra (UPF), Barcelona, Spain; Inria-Asclepios project (INRIA), France. Details on the implementation and evaluation of the four methodologies are presented in this manuscript. The manually tracked landmarks were used to evaluate tracking accuracy of all methodologies. For 3DTAG, median values were computed over all time frames for the phantom dataset (MEVIS=1.20mm, IUCL=0.73mm, UPF=1.10mm, INRIA=1.09mm) and for the volunteer datasets (MEVIS=1.33mm, IUCL=1.52mm, UPF=1.09mm, INRIA=1.32mm). For 3DUS, median values were computed at end diastole and end systole for the phantom dataset (MEVIS=4.40mm, UPF=3.48mm, INRIA=4.78mm) and for the volunteer datasets (MEVIS=3.51mm, UPF=3.71mm, INRIA=4.07mm). For SSFP, median values were computed at end diastole and end systole for the phantom dataset (UPF=6.18mm, INRIA=3.93mm) and for the volunteer datasets (UPF=3.09mm, INRIA=4.78mm). Finally, strain curves were generated and qualitatively compared. Good agreement was found between the different modalities and methodologies, except for radial strain that showed a high variability in cases of lower image quality.

No abstract

BackgroundCardiac CT (CCT) is well suited for a detailed analysis of heart structures due to its high spatial resolution, but in contrast to MRI and echocardiography, CCT does not allow an assessment of intracardiac flow. Computational fluid dynamics (CFD) can complement this shortcoming. It enables the computation of hemodynamics at a high spatio-temporal resolution based on medical images. The aim of this proposed study is to establish a CCT-based CFD methodology for the analysis of left ventricle (LV) hemodynamics and to assess the usability of the computational framework for clinical practice.Materials and MethodsThe methodology is demonstrated by means of four cases selected from a cohort of 125 multiphase CCT examinations of heart failure patients. These cases represent subcohorts of patients with and without LV aneurysm and with severe and no mitral regurgitation (MR). All selected LVs are dilated and characterized by a reduced ejection fraction (EF). End-diastolic and end-systolic image data was used to reconstruct LV geometries with 2D valves as well as the ventricular movement. The intraventricular hemodynamics were computed with a prescribed-motion CFD approach and evaluated in terms of large-scale flow patterns, energetic behavior, and intraventricular washout.ResultsIn the MR patients, a disrupted E-wave jet, a fragmentary diastolic vortex formation and an increased specific energy dissipation in systole are observed. In all cases, regions with an impaired washout are visible. The results furthermore indicate that considering several cycles might provide a more detailed view of the washout process. The pre-processing times and computational expenses are in reach of clinical feasibility.ConclusionThe proposed CCT-based CFD method allows to compute patient-specific intraventricular hemodynamics and thus complements the informative value of CCT. The method can be applied to any CCT data of common quality and represents a fair balance between model accuracy and overall expenses. With further model enhancements, the computational framework has the potential to be embedded in clinical routine workflows, to support clinical decision making and treatment planning.

Cardiac magnetic resonance perfusion examinations enable non-invasive quantification of myocardial blood flow. However, motion between frames due to breathing must be corrected for quantitative analysis. Although several methods have been proposed, there is a lack of widely available benchmarks to compare different algorithms. We sought to compare many algorithms from several groups in an open benchmark challenge. Nine clinical studies from two different centers comprising normal and diseased myocardium at both rest and stress were made available for this study. The primary validation measure was regional myocardial blood flow based on the transfer coefficient (Ktrans), which was computed using a compartment model and the myocardial perfusion reserve (MPR) index. The ground truth was calculated using contours drawn manually on all frames by a single observer, and visually inspected by a second observer. Six groups participated and 19 different motion correction algorithms were compared. Each method used one of three different motion models: rigid, global affine or local deformation. The similarity metric also varied with methods employing either sum-of-squared differences, mutual information or cross-correlation. There were no significant differences in Ktrans or MPR compared across different motion models or similarity metrics. Compared with the ground truth, only Ktrans for the sum of squared differences metric, and for local deformation motion models, had significant bias. In conclusion, the open benchmark enabled evaluation of clinical perfusion indices over a wide range of methods. In particular, there was no benefit of non-rigid registration techniques over the other methods evaluated in this study. The benchmark data and results are available from the Cardiac Atlas Project (www.cardiacatlas.org).