Automatic registration between 3D intra-operative ultrasound and pre-operative CT images of the liver based on robust edge matching

Abstract

The registration of a three-dimensional (3D) ultrasound (US) image with a computed tomography (CT) or magnetic resonance image is beneficial in various clinical applications such as diagnosis and image-guided intervention of the liver. However, conventional methods usually require a time-consuming and inconvenient manual process for pre-alignment, and the success of this process strongly depends on the proper selection of initial transformation parameters. In this paper, we present an automatic feature-based affine registration procedure of 3D intra-operative US and pre-operative CT images of the liver. In the registration procedure, we first segment vessel lumens and the liver surface from a 3D B-mode US image. We then automatically estimate an initial registration transformation by using the proposed edge matching algorithm. The algorithm finds the most likely correspondences between the vessel centerlines of both images in a non-iterative manner based on a modified Viterbi algorithm. Finally, the registration is iteratively refined on the basis of the global affine transformation by jointly using the vessel and liver surface information. The proposed registration algorithm is validated on synthesized datasets and 20 clinical datasets, through both qualitative and quantitative evaluations. Experimental results show that automatic registration can be successfully achieved between 3D B-mode US and CT images even with a large initial misalignment.

Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy

“…The main goal is to directly acquire a 3D image of the zone of interest during the procedure which could be updated at any time during surgery. This can be performed using 3D ultrasound [12], as recently demonstrated by Nam et al for liver surgery applications, or by CT scan [13] or MRI. Shekhar et al proposed to use an intraoperative low-dose CT scan image to update the 3D liver model and to refresh the AR view during surgical manipulation.…”

Fusion imaging of real-time ultrasonography with CT or MRI for hepatic intervention

“…Although prototype automatic image fusion by sweeping the liver volume has been introduced [10], clinical data for hepatic intervention with this automatic registration are rarely available. However, automatic registration is expected to be helpful for less experienced operators with respect to manual registration [11,12]. …”

Position estimation of moving liver lesion based on registration between 2D ultrasound and 4D MR images

“…Using the fixed transducer, we acquire a couple of 3D US images at both inspiration and expiration with a breath-hold. We then perform ICP-based rigid registration to the 4D MR image using 3D features [7]. From this rigid registration results, we can determine the transformation parameters between the 3D US coordinates and the 4D MR image coordinates.…”