Auditory and Visio-Temporal Distance Coding for 3-Dimensional Perception in Medical Augmented Reality

Bork, Felix; Fuers, Bernhard; Schneider, Anja-Katharina; Pinto, Francisco; Graumann, Christoph; Navab, Nassir

doi:10.1109/ismar.2015.16

Cited by 29 publications

(24 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The results of the search yielded 13 articles [4,5,9,10, 12,17,22,34,35,37–40] that met the eligibility criteria. The eligible articles cover a wide range of interventional tasks, implemented auditory display methods, evaluation styles and environments, and findings.…”

Section: Resultsmentioning

confidence: 99%

“…Four of the 13 articles concern needle placement: Wegner and Karron [37], Wegner [38], Black et al [4], and Bork et al [5]. Specifically, Wegner [38] explores a generalized instrument placement task with a tracked drawing device that is meant to aid “… a procedure requiring an insertion trajectory.” Black et al [4] explore radiofrequency needle ablation targeting lesions, and Bork et al [5] support needle biopsy targeting lesions.…”

Section: Resultsmentioning

confidence: 99%

“…A third primary motivation cited by a number of articles is the correct interpretation of navigation information [5,34,39,40]. Bork et al [5] cite the lack of usable depth information in augmented reality applications: “when [augmented reality] visualization is implemented as a simple superimposition of virtual objects on the video stream, the virtual objects appear to float above the anatomy.…”

Section: Resultsmentioning

confidence: 99%

“…Bork et al [5] cite the lack of usable depth information in augmented reality applications: “when [augmented reality] visualization is implemented as a simple superimposition of virtual objects on the video stream, the virtual objects appear to float above the anatomy. This lack of correct depth perception has been recognized as a major challenge,” hoping that auditory display can ameliorate this lack of depth information in the camera view.…”

Section: Resultsmentioning

confidence: 99%

“…Clinicians must remove their view from the operating situs to receive information [17], meaning important notifications might not be perceived [39], and 3-D information might not be correctly interpreted [5]. To remedy some of the deficiencies inherent in visual display, the relatively new field of auditory display [23] presents an interesting possibility for image-guided medicine.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

A Survey of auditory display in image-guided interventions

et al. 2017

View full text Add to dashboard Cite

Purpose This article investigates the current state of the art of the use of auditory display in image-guided medical interventions. Auditory display is a means of conveying information using sound, and we review the use of this approach to support navigated interventions. We discuss the benefits and drawbacks of published systems and outline directions for future investigation. Methods We undertook a review of scientific articles on the topic of auditory rendering in image-guided intervention. This includes methods for avoidance of risk structures and instrument placement and manipulation. The review did not include auditory display for status monitoring, for instance in anesthesia. Results We identified 13 publications in the course of the search. Most of the literature (62%) investigates the use of auditory display to convey distance of a tracked instrument to an object using proximity or safety margins. The remainder discuss continuous guidance for navigated instrument placement. Four of the articles present clinical evaluations, 9 present laboratory evaluations, and 3 present informal evaluation (3 present both laboratory and clinical evaluations). Conclusion Auditory display is a growing field that has been largely neglected in research in image-guided intervention. Despite benefits of auditory displays reported in both the reviewed literature and non-medical fields, adoption in medicine has been slow. Future challenges include increasing interdisciplinary cooperation with auditory display investigators to develop more meaningful auditory display designs and comprehensive evaluations which target the benefits and drawbacks of auditory display in image guidance.

show abstract