DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery

Kersten-Oertel, Marta; Jannin, Pierre; Collins, D. Louis

doi:10.1109/tvcg.2011.50

Cited by 75 publications

(71 citation statements)

References 59 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Therefore, the discussion of some parts of selected papers reported here may appear somewhat redundant. [20] We describe the papers grouping them by function of the real-data source as the type of capturing device used during the actual procedure is, from a surgical point of view, most important.…”

Section: Resultsmentioning

confidence: 99%

Augmented reality in neurosurgery: a systematic review

et al. 2016

View full text Add to dashboard Cite

Neuronavigation has become an essential neurosurgical tool in pursuing minimal invasiveness and maximal safety, even though it has several technical limitations. Augmented reality (AR) neuronavigation is a significant advance, providing a real-time updated 3D virtual model of anatomical details, overlaid on the real surgical field. Currently, only a few AR systems have been tested in a clinical setting. The aim is to review such devices. We performed a PubMed search of reports restricted to human studies of in vivo applications of AR in any neurosurgical procedure using the search terms “Augmented reality” and “Neurosurgery.” Eligibility assessment was performed independently by two reviewers in an unblinded standardized manner. The systems were qualitatively evaluated on the basis of the following: neurosurgical subspecialty of application, pathology of treated lesions and lesion locations, real data source, virtual data source, tracking modality, registration technique, visualization processing, dis- play type, and perception location. Eighteen studies were included during the period 1996 to September 30, 2015. The AR systems were grouped by the real data source: microscope (8), hand- or head-held cameras (4), direct patient view (2), endoscope (1), and X-ray fluoroscopy (1) head-mounted display (1). A total of 195 lesions were treated: 75 (38.46 %) were neoplastic, 77 (39.48 %) neurovascular, and 1 (0.51 %) hydrocephalus, and 42 (21.53 %) were undetermined. Current literature confirms that AR is a reliable and versatile tool when performing minimally invasive approaches in a wide range of neurosurgical diseases, although prospective randomized studies are not yet available and technical improvements are needed.

show abstract

Section: Resultsmentioning

confidence: 99%

Augmented reality in neurosurgery: a systematic review

et al. 2016

View full text Add to dashboard Cite

show abstract

“…Apart from auditory displays, several methods have been described to encode information for navigated interventions using visual augmented reality (AR) [18], e.g., using video see-through displays, optical see-though displays, or projectors to augment the operation with navigation information directly on the patient. However, AR may be accompanied by drawbacks including attention tunneling [9, 20] which may jeopardize patient safety.…”

Section: Discussionmentioning

confidence: 99%

Auditory feedback to support image-guided medical needle placement

et al. 2017

View full text Add to dashboard Cite

Purpose During medical needle placement using image-guided navigation systems, the clinician must concentrate on a screen. To reduce the clinician’s visual reliance on the screen, this work proposes an auditory feedback method as a stand-alone method or to support visual feedback for placing the navigated medical instrument, in this case a needle. Methods An auditory synthesis model using pitch comparison and stereo panning parameter mapping was developed to augment or replace visual feedback for navigated needle placement. In contrast to existing approaches which augment but still require a visual display, this method allows view-free needle placement. An evaluation with 12 novice participants compared both auditory and combined audiovisual feedback against existing visual methods. Results Using combined audiovisual display, participants show similar task completion times and report similar subjective workload and accuracy while viewing the screen less compared to using the conventional visual method. The auditory feedback leads to higher task completion times and subjective workload compared to both combined and visual feedback. Conclusion Audiovisual feedback shows promising results and establish a basis for applying auditory feedback as a supplement to visual information to other navigated interventions, especially those for which viewing a patient is beneficial or necessary.

show abstract

“…This is specially important for medical AR applications, in which physicians must have good understanding of the augmented scene to proceed with their tasks appropriately. Despite the number of techniques and applications which have been proposed for medical AR, only a few of them consider the visualization a relevant aspect for the application [36]. We show here some of the visualization techniques proposed specifically for the field of medical AR to achieve the goal of improved depth perception.…”

Section: Related Workmentioning

confidence: 99%

Focus plus context visualization based on volume clipping for markerless on-patient medical data visualization

Macedo

Apolinário

2015

Computers & Graphics

View full text Add to dashboard Cite

a b s t r a c tFocus plus context visualization can be used in augmented reality to improve the visual perception of the augmented scene. In the scope of in situ or on-patient medical data visualization, the focus plus context paradigm is used to improve depth perception for physicians showing the patient's anatomy as a focus region in the context of the patient's body. Volume clipping is one technique to realize focus plus context visualization. However, some of the existing methods for focus plus context visualization based on volume clipping do not run in full real time or are prone to artifacts. In this paper, we present an extension for two of these techniques to improve performance and image quality of the original approaches. We validate all the techniques in a markerless augmented reality environment. A 3D reference model is tracked by the application, and volumetric medical data are shown to the user at the position of the patient's anatomy. Our technique is able to handle multiple anatomic regions, although the main region of interest used in this paper is the face. Moreover, tracking accuracy is improved by the use of a hierarchical approach. From an evaluation of the proposed techniques, the results obtained highlight that all of them are free of artifacts, optimized for real-time performance, and improve the visual quality of the augmented scene.

show abstract

DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery

Cited by 75 publications

References 59 publications

Augmented reality in neurosurgery: a systematic review

Augmented reality in neurosurgery: a systematic review

Auditory feedback to support image-guided medical needle placement

Focus plus context visualization based on volume clipping for markerless on-patient medical data visualization

Contact Info

Product

Resources

About