An Image Overlay system for medical data visualization

Blackwell, Mike; Nikou, Constantinos; DiGioia, Anthony M.; Kanade, Takeo

doi:10.1016/s1361-8415(00)00007-4

Cited by 100 publications

(42 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although many registration methods have been studied in the field of augmented reality [4,5], they do not lend themselves well to a lightweight design, for depending heavily on dedicated instrumentation and intensive calculation. A complicated calibration procedure would certainly be prohibitive to widespread use of the device.…”

Section: Registration Methodsmentioning

confidence: 99%

“…The concept of a 3D image using a half-mirror is not a new one, related research has been presented by several investigators, also including our group [1,2,3,4,6,9,10]. As mentioned earlier, Stetten's ultrasound display mechanism uses the same overlay concept, yet it targets an entirely different set of applications and clinical problems.…”

Section: Fig 4 Phantom Experimentsmentioning

confidence: 99%

See 1 more Smart Citation

An Image Overlay System with Enhanced Reality for Percutaneous Therapy Performed Inside CT Scanner

Masamune

Fichtinger

Deguet

et al. 2002

Medical Image Computing and Computer-Assisted Intervention — MICCAI 2002

View full text Add to dashboard Cite

Abstract. We describe a simple, safe, and inexpensive image overlay system to assist surgical interventions inside a conventional CT scanner. The overlay system is mounted non-invasively on the gantry of the CT scanner and it consists of a seven degrees-of-freedom passive mounting arm, a flat LCD display, and a light brown acrylic plate as a half mirror. In a pre-operative calibration process, the display, half-mirror, and imaging plane of the scanner are spatially registered by imaging a triangular calibration object. Following the calibration, the patient is brought into the scanner, an image is acquired and sent to the overlay display via DICOM transfer. Looking at the patient through the half-mirror, the CT image appears to be floating inside the patient in correct size and position. This vision enables the physician to see both the surface and the inside of the patient at the same time, which can be utilized in guiding a surgical intervention. The complete system fits into a carry-on suitcase (except the mounting adapter), it is easy to calibrate, mounts non-invasively on the scanner, without utilizing vendor-specific features of he scanner.

show abstract

Section: Registration Methodsmentioning

confidence: 99%

Section: Fig 4 Phantom Experimentsmentioning

confidence: 99%

An Image Overlay System with Enhanced Reality for Percutaneous Therapy Performed Inside CT Scanner

Masamune

Fichtinger

Deguet

et al. 2002

Medical Image Computing and Computer-Assisted Intervention — MICCAI 2002

View full text Add to dashboard Cite

show abstract

“…Alternatively, guidance information could be displayed on top of the patient. "Image Overlay"-like solutions [5,18] have been developed but remain cumbersome in an operating theatre. The guidance information could also be provided through tactile feedback [19].…”

Section: Continuity and Compatibility: Empirical Studies Of Caspermentioning

confidence: 99%

Assessing continuity and compatibility in augmented reality systems

Dubois

Nigay

Troccaz

2002

UAIS

View full text Add to dashboard Cite

Abstract. Integrating computer-based information into the real world of the user, is becoming a crucial challenge for the designers of interactive systems. The Augmented Reality (AR) paradigm illustrates this trend. Information is provided by the AR system to facilitate or to enrich the natural way the user interacts with the real environment. We focus on the outputs of such systems, so that additional information is smoothly integrated with the real environment of the user. We characterize the integration of the computer-provided entities with the real ones using two new properties: compatibility and continuity. After defining the two properties, we provide the elements and analytical method needed for assessing them. We also empirically study the two properties in order to highlight their impact on the interaction. The CASPER system, developed in our teams, is used to illustrate the discussion.

show abstract

“…Fusion may be accomplished with a direct view of the real scene by combining the virtual information with the direct optical view, e.g., using half-silvered mirrors [1], or by electronically fusing the virtual model with a video image of the operating field [2,3]. The direct optical view offers several advantages compared to the video fusion approach because it can provide better depth perception.…”

Section: Introductionmentioning

confidence: 99%

Fusion and visualization of intraoperative cortical images with preoperative models for epilepsy surgical planning and guidance

Wang

Mirsattari

Parrent

et al. 2011

Computer Aided Surgery

View full text Add to dashboard Cite

Objective: During epilepsy surgery it is important for the surgeon to correlate the preoperative cortical morphology (from preoperative images) with the intraoperative environment. Augmented Reality (AR) provides a solution for combining the real environment with virtual models. However, AR usually requires the use of specialized displays, and its effectiveness in the surgery still needs to be evaluated. The objective of this research was to develop an alternative approach to provide enhanced visualization by fusing a direct (photographic) view of the surgical field with the 3D patient model during image guided epilepsy surgery. Materials and Methods: We correlated the preoperative plan with the intraoperative surgical scene, first by a manual landmark-based registration and then by an intensity-based perspective 3D-2D registration for camera pose estimation. The 2D photographic image was then texture-mapped onto the 3D preoperative model using the solved camera pose. In the proposed method, we employ direct volume rendering to obtain a perspective view of the brain image using GPUaccelerated ray-casting. The algorithm was validated by a phantom study and also in the clinical environment with a neuronavigation system. Results: In the phantom experiment, the 3D Mean Registration Error (MRE) was 2.43 AE 0.32 mm with a success rate of 100%. In the clinical experiment, the 3D MRE was 5.15 AE 0.49 mm with 2D in-plane error of 3.30 AE 1.41 mm. A clinical application of our fusion method for enhanced and augmented visualization for integrated image and functional guidance during neurosurgery is also presented. Conclusions: This paper presents an alternative approach to a sophisticated AR environment for assisting in epilepsy surgery, whereby a real intraoperative scene is mapped onto the surface model of the brain. In contrast to the AR approach, this method needs no specialized display equipment. Moreover, it requires minimal changes to existing systems and workflow, and is therefore well suited to the OR environment. In the phantom and in vivo clinical experiments, we demonstrate that the fusion method can achieve a level of accuracy sufficient for the requirements of epilepsy surgery.

show abstract

An Image Overlay system for medical data visualization

Cited by 100 publications

References 5 publications

An Image Overlay System with Enhanced Reality for Percutaneous Therapy Performed Inside CT Scanner

An Image Overlay System with Enhanced Reality for Percutaneous Therapy Performed Inside CT Scanner

Assessing continuity and compatibility in augmented reality systems

Fusion and visualization of intraoperative cortical images with preoperative models for epilepsy surgical planning and guidance

Contact Info

Product

Resources

About