Overview of the holographic-guided cardiovascular interventions and training – a perspective

Abstract

Immersive technologies, like Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR) have undergone technical evolutions over the last few decades. Their rapid development and dynamic changes enable their effective applications in medicine, in fields like imaging, preprocedural planning, treatment, operations planning, medical students training, and active support during therapeutic and rehabilitation procedures. Within this paper, a comprehensive analysis of VR/AR/MR application in the medical industry and education is presented. We overview and discuss our previous experience with AR/MR and 3D visual environment and MR-based imaging systems in cardiology and interventional cardiology. Our research shows that using immersive technologies users can not only visualize the heart and its structure but also obtain quantitative feedback on their location. The MR-based imaging system proposed offers better visualization to interventionists and potentially helps users understand complex operational cases. The results obtained suggest that technology using VR/AR/MR can be successfully used in the teaching process of future doctors, both in aspects related to anatomy and clinical classes. Moreover, the system proposed provides a unique opportunity to break the boundaries, interact in the learning process, and exchange experiences inside the medical community.

Intraoperative Use of Mixed Reality Technology in Median Neck and Branchial Cyst Excision

“…This has opened up opportunities for more effective diagnostics and intraoperative treatment through the visualization of various types of data. Now, Microsoft HoloLens is widely used in research planning [6], training [7,8], and in performing surgical operations [9] using mixed reality technology.…”