Automatic non-linear mapping of pre-procedure CT volumes to 3D ultrasound

Abstract

Multi-modality alignment of CT and ultrasound adds value to diagnostic examinations, as well as treatment planning and execution of various clinical procedures. Particularly automatic image-based alignment of such data is challenging, mostly because both modalities have very different imaging physics and characteristics. We present a method for dense-field deformable registration of CT and 3D ultrasound. Compared to global (rigid) alignment, this is more difficult to solve, because modality-specific difference in local anatomic appearance can result in incorrect displacements. We use a simulation of ultrasonic effects based on CT information, taking the current estimate of the deformation field into account to properly address orientation-dependent imaging artifacts. This is combined with a robust multi-channel local similarity metric, driving a variational registration framework. Because of the high computational demand, an efficient GPU-based implementation is used. Preliminary results are shown on data from a number of hepatic cancer patients. To our knowledge, this is the first time that a non-linear mapping of CT and 3D B-mode ultrasound is established in a computationally practical and fully automatic manner.

Augmented Reality and Robotic-Assistance for Percutaneous Nephrolithotomy

“…This is due to the fact that the orientation estimation is mediated by the use of all the markers, while the translation strongly depends on the ability of the HoloLens camera to recognize the position of the single marker. As will be described in Section IV, this error can be strongly mitigated by considering additional information, such as merging the HoloLens data with the information acquired in real-time through an ultrasound probe or through an external tracking system, or by integrating into the architecture an automatic CT-ultrasound registration as proposed in [24], in order to achieve an acceptable error lower than 4-5 mm, which is almost the half of the average size of the calyx diameter. Moreover, in a real PCNL procedure, the registration can be further improved by compensating the respiratory motion of the patient, as suggested in [17].…”

In-situ imaging of articular cartilage of the first carpometacarpal joint using co-registered optical coherence tomography and computed tomography

“…Nonetheless, a very good registration between the CT and OCT images was acquired. In the future, however, this may even be improved by using newly developed software and hardware that enables deformable registration of the two imaging modalities in 3-D. 16 Histologic assessment played an important role in determining the feasibility of this experimental setup. Matching orientation and location of the histologic slides with landmarks as seen on OCT was complicated.…”

Uncertainty Estimation for Improving Accuracy of Non-rigid Registration in Cardiac Images

“…For each pixel in all images, its registration uncertainty can be evaluated and visualized using equation (1). We can further define the registration uncertainty of a given region by averaging over the region.…”