Illustrative visualization of 3D planning models for augmented reality in liver surgery

Abstract

Purpose: Augmented Reality (AR) obtains increasing acceptance in the operating room. However, a meaningful augmentation of the surgical view with a 3D visualization of planning data which allows reliable comparisons of distances and spatial relations is still an open request. Methods: We introduce methods for intraoperative visualization of 3D planning models which extend illustrative rendering and AR techniques. We aim to reduce visual complexity of 3D planning models and accentuate spatial relations between relevant objects. The main contribution of our work is an advanced silhouette algorithm for 3D planning models (distance-encoding silhouettes) combined with procedural textures (distance-encoding surfaces). In addition, we present a method for illustrative visualization of resection surfaces. Results: The developed algorithms have been embedded into a clinical prototype that has been evaluated in the operating room. To verify the expressiveness of our illustration methods, we performed a user study under controlled conditions. The study revealed a clear advantage in distance assessment with the proposed illustrative approach in comparison to classical rendering techniques. Conclusion:The presented illustration methods are beneficial for distance assessment in surgical AR. To increase the safety of interventions with the proposed approach, reduction of inaccuracies in tracking and registration are subject of our current research.

A Meta-Analytic and Thematic Comparative Analysis of the Integration of Augmented Reality Applications into Education

“…Bugüne kadar artırılmış gerçeklik araçları; reklam, pazarlama, mühendislik, müze, mimarlık, inşaat, eğlence, sağlık alanları ve askeri alanlarda kullanılmıştır (Azuma, 1997;Barfield, 2015;Hansen, Wieferich, Ritter, Rieder ve Petigen, 2010;Feiner, 2002;Karatay, 2015;Küçük, Kapakin ve Göktaş, 2015;Sayımer ve Küçüksaraç, 2015;Uğur ve Ceylan, 2014;Koşan, 2014). Ancak mobil cihazların (masaüstü ve diz üstü bilgisayarlar, taşınabilir cihaz, akıllı telefonlar vs.) kullanımının artmasıyla birlikte artırılmış gerçeklik uygulamaları (AGU) eğitimde de kullanılmaya başlanmıştır (Billinghurst, 2002;Johnson, Smith, Levine ve Hywood, 2010;Uluyol ve Eryılmaz, 2014).…”

Navigation Surgery Using an Augmented Reality for Pancreatectomy

“…Therefore, the development of intraoperative navigation surgery followed by simulation had been promising [22,23,24,25]. However, there have not been many studies on AR-based NS applicable for clinical practice by facing the obstacle of organ deformity [8,26,27,28,29,30,31,32,33]. Although many investigations using current engineering technologies and mathematical algorithms have been reported to overcome problems associated with organ deformity, most systems are not practical because of complicated methods and insufficient [28,29,32,33,34].…”

Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies

“…Depth information could be recovered in future applications by coding it into the models being projected as suggested for example by Hansen et al [1].…”

“…However, authors such as Hansen et al [1] and Sugimoto et al [2] have reported on the disadvantages of displaying navigation data on a separate screen. Hansen concluded that mental fusion of planning models with the current surgical view was error-prone and that it frequently resulted in distracting comparisons during the intervention that consumed an unacceptable amount of time.…”