The state of the art of visualization in mixed reality image guided surgery

Kersten-Oertel, Marta; Jannin, Pierre; Collins, D. Louis

doi:10.1016/j.compmedimag.2013.01.009

Cited by 134 publications

(77 citation statements)

References 37 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although AR in neurosurgery is a promising frontier, and several devices have been tested in vitro,[21,19] the clinical experience with such systems appears to be quite limited. [17,22,11,29,23,14,32,4,3,15,8,5] We present a literature review aiming to: describe and evaluate the advantages and shortcomings of each of the different AR setups tested in vivo in humans; to understand the efficacy of AR in the treatment of neurosurgical diseases; and, to define potential future research directions.…”

Section: Introductionmentioning

confidence: 99%

Augmented reality in neurosurgery: a systematic review

et al. 2016

View full text Add to dashboard Cite

Neuronavigation has become an essential neurosurgical tool in pursuing minimal invasiveness and maximal safety, even though it has several technical limitations. Augmented reality (AR) neuronavigation is a significant advance, providing a real-time updated 3D virtual model of anatomical details, overlaid on the real surgical field. Currently, only a few AR systems have been tested in a clinical setting. The aim is to review such devices. We performed a PubMed search of reports restricted to human studies of in vivo applications of AR in any neurosurgical procedure using the search terms “Augmented reality” and “Neurosurgery.” Eligibility assessment was performed independently by two reviewers in an unblinded standardized manner. The systems were qualitatively evaluated on the basis of the following: neurosurgical subspecialty of application, pathology of treated lesions and lesion locations, real data source, virtual data source, tracking modality, registration technique, visualization processing, dis- play type, and perception location. Eighteen studies were included during the period 1996 to September 30, 2015. The AR systems were grouped by the real data source: microscope (8), hand- or head-held cameras (4), direct patient view (2), endoscope (1), and X-ray fluoroscopy (1) head-mounted display (1). A total of 195 lesions were treated: 75 (38.46 %) were neoplastic, 77 (39.48 %) neurovascular, and 1 (0.51 %) hydrocephalus, and 42 (21.53 %) were undetermined. Current literature confirms that AR is a reliable and versatile tool when performing minimally invasive approaches in a wide range of neurosurgical diseases, although prospective randomized studies are not yet available and technical improvements are needed.

show abstract

Section: Introductionmentioning

confidence: 99%

Augmented reality in neurosurgery: a systematic review

et al. 2016

View full text Add to dashboard Cite

show abstract

“…To characterize different components used to build a mixed reality system for image-guided surgery (IGS), a taxonomy called data, visualization processing, view (DVV) [14,15] was proposed. In this paper, we alter the general DVV taxonomy to a more specific classification for HMD-based mixed reality interventions.…”

Section: Introductionmentioning

confidence: 99%

Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display

et al. 2017

View full text Add to dashboard Cite

Purpose Optical see-through head-mounted displays (OST-HMD) feature an unhindered and instantaneous view of the surgery site and can enable a mixed reality experience for surgeons during procedures. In this paper, we present a systematic approach to identify the criteria for evaluation of OST-HMD technologies for specific clinical scenarios, which benefit from using an object-anchored 2D-display visualizing medical information. Methods Criteria for evaluating the performance of OST-HMDs for visualization of medical information and its usage are identified and proposed. These include text readability, contrast perception, task load, frame rate, and system lag. We choose to compare three commercially available OST-HMDs, which are representatives of currently available head-mounted display technologies. A multi-user study and an offline experiment are conducted to evaluate their performance. Results Statistical analysis demonstrates that Microsoft HoloLens performs best among the three tested OST-HMDs, in terms of contrast perception, task load, and frame rate, while ODG R-7 offers similar text readability. The integration of indoor localization and fiducial tracking on the HoloLens provides significantly less system lag in a relatively motionless scenario. Conclusions With ever more OST-HMDs appearing on the market, the proposed criteria could be used in the evaluation of their suitability for mixed reality surgical intervention. Currently, Microsoft HoloLens may be more suitable than ODG R-7 and Epson Moverio BT-200 for clinical usability in terms of the evaluated criteria. To the best of our knowledge, this is the first paper that presents a methodology and conducts experiments to evaluate and compare OST-HMDs for their use as object-anchored 2D-display during interventions.

show abstract

“…In this way, AR establishes a functional and ergonomic integration between surgical navigation and virtual planning by providing physicians with a virtual navigation aid contextually blended within the real surgical scenario [2].…”

Section: Introductionmentioning

confidence: 99%

Robust and Accurate Algorithm for Wearable Stereoscopic Augmented Reality with Three Indistinguishable Markers

et al. 2016

View full text Add to dashboard Cite

Abstract:In the context of surgical navigation systems based on augmented reality (AR), the key challenge is to ensure the highest degree of realism in merging computer-generated elements with live views of the surgical scene. This paper presents an algorithm suited for wearable stereoscopic augmented reality video see-through systems for use in a clinical scenario. A video-based tracking solution is proposed that relies on stereo localization of three monochromatic markers rigidly constrained to the scene. A PnP-based optimization step is introduced to refine separately the pose of the two cameras. Video-based tracking methods using monochromatic markers are robust to non-controllable and/or inconsistent lighting conditions. The two-stage camera pose estimation algorithm provides sub-pixel registration accuracy. From a technological and an ergonomic standpoint, the proposed approach represents an effective solution to the implementation of wearable AR-based surgical navigation systems wherever rigid anatomies are involved.

show abstract

The state of the art of visualization in mixed reality image guided surgery

Cited by 134 publications

References 37 publications

Augmented reality in neurosurgery: a systematic review

Augmented reality in neurosurgery: a systematic review

Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display

Robust and Accurate Algorithm for Wearable Stereoscopic Augmented Reality with Three Indistinguishable Markers

Contact Info

Product

Resources

About