Hybrid Simulation and Planning Platform for Cryosurgery with Microsoft HoloLens

Abstract

Cryosurgery is a technique of growing popularity involving tissue ablation under controlled freezing. Technological advancement of devices along with surgical technique improvements have turned cryosurgery from an experimental to an established option for treating several diseases. However, cryosurgery is still limited by inaccurate planning based primarily on 2D visualization of the patient’s preoperative images. Several works have been aimed at modelling cryoablation through heat transfer simulations; however, most software applications do not meet some key requirements for clinical routine use, such as high computational speed and user-friendliness. This work aims to develop an intuitive platform for anatomical understanding and pre-operative planning by integrating the information content of radiological images and cryoprobe specifications either in a 3D virtual environment (desktop application) or in a hybrid simulator, which exploits the potential of the 3D printing and augmented reality functionalities of Microsoft HoloLens. The proposed platform was preliminarily validated for the retrospective planning/simulation of two surgical cases. Results suggest that the platform is easy and quick to learn and could be used in clinical practice to improve anatomical understanding, to make surgical planning easier than the traditional method, and to strengthen the memorization of surgical planning.

Applications of Mixed Reality Technology in Orthopedics Surgery: A Pilot Study

“…Furthermore, preliminary studies have also shown that MR offers an improved training modality for orthopedic residents. A similar study by Condino et al explored a mixed-reality platform using HoloLens, demonstrating its application as a hybrid training system for orthopedic open surgery with a reduced learning curve (Condino et al, 2021a). In an intraoperative setting, surgeons could access anatomical information of the patient through the MR system and HoloLens glasses, then superimpose virtual holographic elements onto the actual superficial anatomy of the patient while on surgical table, in real time.…”

“…To the best of our knowledge, this study is the first case series detailing the clinical-use workflow of MR hologram in different scenarios during orthopaedics surgery. Similar to previous studies ( Bowyer et al, 2010 ; Craig et al, 2010 ; Drake et al, 2014 ; Moro et al, 2017 ; Ferro et al, 2019 ; Condino et al, 2021a ), we initially used mixed reality technologies for conventional applications of teaching and training, where MR-HMDs are typically put on for intuitive demonstrations and simulations in anatomy courses. However, we have come to realize a great MR potential in analyzing bone fractures, particularly in displaying their 3D structures, and understanding their types and degrees.…”

“…Furthermore, preliminary studies have also shown that MR offers an improved training modality for orthopedic residents. A similar study by Condino et al explored a mixed-reality platform using HoloLens, demonstrating its application as a hybrid training system for orthopedic open surgery with a reduced learning curve ( Condino et al, 2021a ).…”

Single Evaluation of Use of a Mixed Reality Headset for Intra-Procedural Image-Guidance during a Mock Laparoscopic Myomectomy on an Ex-Vivo Fibroid Model

“…Very recently, Condino et al [22] proposed a hybrid simulation and planning platform harnessing Microsoft HoloLens for Cryosurgery. In this work, a qualitative study was carried out to preliminarily evaluate the proposed system for retrospective simulation of two surgical cases.…”

Mixed Reality-Based Interaction between Human and Virtual Cat for Mental Stress Management

“…With the development of virtual reality, frameworks are being developed that can simulate situations that cannot be easily engaged with in reality, providing users with a high sense of reality and smooth interactions [ 16 ]. Furthermore, in contrast to existing entertainment platforms, realization of augmented reality (AR) and mixed reality (MR) techniques can enable the virtual animals to be engaged with in the real world, sharing the same physical space as that of humans.…”