Live delivery of neurosurgical operating theater experience in virtual reality

Abstract

A system for assisting in microneurosurgical training and for delivering interactive mixed reality surgical experience live was developed and experimented in hospital premises. An interactive experience from the neurosurgical operating theater was presented together with associated medical content on virtual reality eyewear of remote users. Details of the stereoscopic 360‐degree capture, surgery imaging equipment, signal delivery, and display systems are presented, and the presence experience and the visual quality questionnaire results are discussed. The users reported positive scores on the questionnaire on topics related to the user experience achieved in the trial.

Augmented reality in neurosurgical navigation: A survey

“…and human factors (people's perception, movement, and cognitive ability). The author 73 used 3D printing to achieve holographic visualization of the virtual brain and applied AR to brain tumour surgery training more naturally and intuitively. In Ghandorh et al 84 studied the effect of the neurosurgical simulator on improving the motion perception of trainers.…”

“…In an era of limited hours for residents, teaching institutions in neurosurgery have recently begun experimenting with simulation‐based training methods. In recent years, the use of virtual and AR platforms in healthcare education has increased 17,23,76–81 . These have been used in teaching anatomy, emergency simulation, and procedural training.…”

From Real to Virtual: An Image-Based Rendering Toolkit to Help Bring the World Around Us Into Virtual Reality

“…Additionally, image-based assets can be used in VR documentaries, to inform about and create empathy for a given circumstance [7]: for example, volumetric capture technologies can be used to place immersed viewers face-to-face with real-world people, telling their account of living through a specific situation. Furthermore, photographs and videos can be used to create compelling virtual task training environments, that accurately depict real-world situations such as high-risk surgical operations [19] and firefighter interventions in dangerous conditions. Such experiences, in which multiple generations of trainees can be immersed for no additional cost and with no exposure to danger, are indeed particularly relevant when the corresponding live training is costly or dangerous.…”

“…Many of these use cases have been explored by expert researchers but also casual developers and content creators, making use of low-cost camera rigs and 3D reconstruction tools to develop small-scale VR experiences in which parts of the real world are rendered virtually [26]. As hospitals start using 360°images for interactive neurosurgery training [19] and local museums investigate visitors' expectations for the integration of VR exhibits [16], it thus seems safe to say that virtual reality has never been more present in our everyday lives.…”

EEG analysis of mixed‐reality music rehabilitation system for post‐stroke lower limb therapy

“…VR has become a hot technology in recent years. This state of the art technology shed new lights on many different fields including the clinical applications such as the surgical training experience system and pain management . One of the clinical VR application is neural rehabilitation.…”