Augmented reality navigation system for laparoscopic splenectomy in children based on preoperative CT image using optical tracking device

Ieiri, Satoshi; Uemura, Munenori; Konishi, Kensuke; Souzaki, Ryota; Nagao, Yuhei; Tsutsumi, Norifumi; Akahoshi, Tomohiko; Ohuchida, Kenoki; Ohdaira, Takeshi; Tomikawa, Morimasa; Tanoue, Kazuo; Hashizume, Makoto; Taguchi, Tomoaki

doi:10.1007/s00383-011-3034-x

Cited by 73 publications

(43 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Therefore, the basic data obtained in open surgery seems significant for the next step of minimally invasive surgery. In practice, several issues to be overcome for clinical application of this system include registration accuracy, the position of the scope that carries the tracking system, and increased deformability of the soft organs [2,32,33,37,43,44,45]. Another advantage of the current system seems to be the educational benefits that can be achieved through the ability to share information with surgical trainees, co-medical staff, and students.…”

Section: Discussionmentioning

confidence: 99%

Navigation Surgery Using an Augmented Reality for Pancreatectomy

et al. 2015

View full text Add to dashboard Cite

Aim: The aim of this study was to evaluate the utility of navigation surgery using augmented reality technology (AR-based NS) for pancreatectomy. Methods: The 3D reconstructed images from CT were created by segmentation. The initial registration was performed by using the optical location sensor. The reconstructed images were superimposed onto the real organs in the monitor display. Of the 19 patients who had undergone hepatobiliary and pancreatic surgery using AR-based NS, the accuracy, visualization ability, and utility of our system were assessed in five cases with pancreatectomy. Results: The position of each organ in the surface-rendering image corresponded almost to that of the actual organ. Reference to the display image allowed for safe dissection while preserving the adjacent vessels or organs. The locations of the lesions and resection line on the targeted organ were overlaid on the operating field. The initial mean registration error was improved to approximately 5 mm by our refinements. However, several problems such as registration accuracy, portability and cost still remain. Conclusion: AR-based NS contributed to accurate and effective surgical resection in pancreatectomy. The pancreas appears to be a suitable organ for further investigations. This technology is promising to improve surgical quality, training, and education.

show abstract

Section: Discussionmentioning

confidence: 99%

Navigation Surgery Using an Augmented Reality for Pancreatectomy

et al. 2015

View full text Add to dashboard Cite

show abstract

“…(Marescaux et al, 2004;Mutter et al, 2010;Nozaki et al, 2012;Pratt et al, 2012)) proposed manual alignment of pre-operatively and intra-operatively acquired images. The majority of (semi-) automatic approaches for registering the endoscopic image data with 3D anatomical data acquired pre-or intra-operatively are either marker-based (Baumhauer et al, 2008;Falk et al, 2005;Ieiri et al, 2011;Marvik et al, 2004;Megali et al, 2008;Mourgues et al, 2003;Simpfendorfer et al, 2011;Suzuki et al, 2008) or use external tracking devices that are initially calibrated with respect to the imaging modality (Ukimura and Gill, 2008;Konishi et al, 2007;Shekhar et al, 2010;Feuerstein et al, 2008;Konishi et al, 2007;Feuerstein et al, 2007;Leven et al, 2005;Blackall et al, 2000)). In an alternative approach, reconstructed surface data may be used to perform the registration with pre-operative models (Audette et al, 2000).…”

Section: Intra-operative Registration For Augmented Reality Guidancementioning

confidence: 99%

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

Maier-Hein

Mountney

Bartoli

et al. 2013

Medical Image Analysis

242

130

View full text Add to dashboard Cite

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-operative morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon's navigation capabilites by observing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted instruments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D optical imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions.

show abstract

“…Indeed, in such procedures, the surgeon operates watching endoscopic video images reproduced on the spatial display unit [8,9]. Therefore, the virtual information is usually merged with real-time video frames grabbed by the endoscope and presented on a stand-up monitor [10][11][12].…”

Section: Introductionmentioning

confidence: 99%

Robust and Accurate Algorithm for Wearable Stereoscopic Augmented Reality with Three Indistinguishable Markers

et al. 2016

View full text Add to dashboard Cite

Abstract:In the context of surgical navigation systems based on augmented reality (AR), the key challenge is to ensure the highest degree of realism in merging computer-generated elements with live views of the surgical scene. This paper presents an algorithm suited for wearable stereoscopic augmented reality video see-through systems for use in a clinical scenario. A video-based tracking solution is proposed that relies on stereo localization of three monochromatic markers rigidly constrained to the scene. A PnP-based optimization step is introduced to refine separately the pose of the two cameras. Video-based tracking methods using monochromatic markers are robust to non-controllable and/or inconsistent lighting conditions. The two-stage camera pose estimation algorithm provides sub-pixel registration accuracy. From a technological and an ergonomic standpoint, the proposed approach represents an effective solution to the implementation of wearable AR-based surgical navigation systems wherever rigid anatomies are involved.

show abstract

Augmented reality navigation system for laparoscopic splenectomy in children based on preoperative CT image using optical tracking device

Abstract: This navigation system provides real-time anatomical information, which cannot be otherwise visualized without navigation. The registration accuracy was acceptable in clinical operation.

Cited by 73 publications

References 11 publications

Navigation Surgery Using an Augmented Reality for Pancreatectomy

Navigation Surgery Using an Augmented Reality for Pancreatectomy

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

Robust and Accurate Algorithm for Wearable Stereoscopic Augmented Reality with Three Indistinguishable Markers

Contact Info

Product

Resources

About