Abstract. Vision-based tracking of laparoscopic tools offers new possibilities for improving surgical training and for developing new augmented reality surgical applications. We present an original method to determine not only the tip position, but also the orientation of a laparoscopic tool respect to the camera coordinate frame. A simple mathematical formulation shows how segmented tool edges and camera field of view define the tool 3D orientation. Then, 3D position of the tool tip is determined by image 2D coordinates of any known point of the tool and by tool's diameter. Accuracy is evaluated in real image sequences with known ground truth. Results show a positioning error of 9,28 mmRMS, what is explained by inaccuracies in the estimation of tool edges. The main advantage of proposed method is its robustness to occlusions of the tool tip.

A novel three-dimensional (3D) camera is capable of providing high-precision 3D images in real time. The camera uses a diode laser to illuminate the scene, a shuttered solid-state charge-coupled device (CCD) sensor, and a simple phase detection technique based on the sensor shutter. The amplitude of the reflected signal carries the luminance information, while the phase of the signal carries range information. The system output is coded as a video signal. This camera offers significant advantages over existing technology. The precision in range is dependent only on phase shift and laser power and theoretically is far superior to existing time-of-flight laser radar systems. Other advantages are reduced size and simplicity and compact and inexpensive construction. We built a prototype that produced high-resolution images in range the (z) and x-y.

No abstract

Purpose: Current radiotherapy is progressing to the concept of adaptive radiotherapy, which implies the adaptation of planning along the treatment course. Nonrigid registration is an essential image processing tool for adaptive radiotherapy and image guided radiotherapy, and the threedimensional (3D) nature of the current radiotherapy techniques requires a 3D quantification of the registration error that existing evaluation methods do not cover appropriately. The authors present a method for 3D evaluation of nonrigid registration algorithms' performance, based on organ delineations, capable of working with near-spherical volumes even in the presence of concavities. Methods: The evaluation method is composed by a volume shape description stage, developed using a new ad hoc volume reconstruction algorithm proposed by the authors, and an error quantification stage. The evaluation method is applied to the organ delineations of prostate and seminal vesicles, obtained by an automatic segmentation method over images of prostate cancer patients treated with intensity modulated radiation therapy. Results: The volume reconstruction algorithm proposed has been shown to accurately model complex 3D surfaces by the definition of clusters of control points. The quantification method, inspired by the Haussdorf-Chebysev distance, provides a measure of the largest registration error per control direction, defining a valid metric for concave-convex volumes. Summarizing, the proposed evaluation methodology presents accurate results with a high spatial resolution in a negligible computation time in comparison with the nonrigid registration time. Conclusions: Experimental results show that the metric selected for quantifying the registration error is of utmost importance in a quantitative evaluation based on measuring distances between volumes. The accuracy of the volume reconstruction algorithm is not so relevant as long as the reconstruction is tight enough on the actual volume of the organ. The new evaluation method provides a smooth and accurate volume reconstruction for both the reference and the registered organ, and a complete 3D description of nonrigid registration algorithms' performance, resulting in a useful tool for study and comparison of registration algorithms for adaptive radiotherapy.

Abstract.A trend in abdominal surgery is the transition from minimally invasive surgery to surgeries where augmented reality is used. Endoscopic video images are proposed to be employed for extracting useful information to help surgeons performing the operating techniques. This work introduces an illumination model into the design of automatic segmentation algorithms and 3D reconstruction methods. Results obtained from the implementation of our methods to real images are supposed to be an initial step useful for designing new methodologies that will help surgeons operating MIS techniques.