Clinical Feasibility of a Wearable Mixed-Reality Device in Neurosurgery

Incekara, Fatih; Smits, Marion; Dirven, Clemens M.F.; Vincent, Arnaud

doi:10.1016/j.wneu.2018.06.208

Cited by 152 publications

(120 citation statements)

References 16 publications

Supporting

Mentioning

118

Contrasting

Order By: Relevance

“…The pose of the HoloLens is determined by a proprietary algorithm for Simultaneous localization and mapping (SLAM), which estimates the estates (i.e., position, orientation, linear accelerations, and angular velocities) of the headset with respect to the physical space by combining multi‐sensor data fusion techniques, e.g., inertial, depth, and visual cues. Recently, several studies have explored the possibility of using the Microsoft HoloLens in neurosurgery, reconstructive and plastic surgery, liver cancer surgery, endovascular surgery, and in telemedicine . In all these previously mentioned studies, the authors have not estimated the transformation between the physical and virtual reference frames.…”

Section: Introductionmentioning

confidence: 99%

A hand‐eye calibration method for augmented reality applied to computer‐assisted orthopedic surgery

Oliveira

Debarba

Lädermann

et al. 2018

Robotics Computer Surgery

View full text Add to dashboard Cite

Background: Augmented reality (AR) allows the surgeon to represent holographic patient-specific anatomical information and surgical instruments in the physical world. To correctly superimpose virtual and physical objects, a hand-eye (HE) calibration method for mapping the virtual and physical spaces was proposed.Methods: Mathematical relationships between the virtual camera and the physical space were derived. Finally, the accuracy and robustness of the proposed HE calibration method were qualitatively and quantitatively evaluated. Results:The proposed calibration method allows us to determine an optimal invariant spatiotemporal mapping between the virtual camera and the physical space. Conclusion:Qualitatively and quantitatively reliable and accurate estimates for the physical-virtual mapping transformation were verified. Consequently, imaging data and surgical instruments holograms can be precisely represented in the physical space.

show abstract

Section: Introductionmentioning

confidence: 99%

A hand‐eye calibration method for augmented reality applied to computer‐assisted orthopedic surgery

Oliveira

Debarba

Lädermann

et al. 2018

Robotics Computer Surgery

View full text Add to dashboard Cite

show abstract

“…Recently, surgical intraoperative navigation as well as preoperative surgical simulation based on VR, MR, and AR have been developed and successfully used in various surgical fields including neurosurgery, liver surgery, kidney surgery, and orthopedic surgery [47][48][49][50][51]. In contrast to 2D interfaces (e.g.…”

Section: Virtual Reality Augmented Reality and Mixed Realitymentioning

confidence: 99%

The Realm of Oncological Lung Surgery: From Past to Present and Future Perspectives

Maat¹,

Sadeghi²,

Bogers³

et al. 2020

Update in Respiratory Diseases

View full text Add to dashboard Cite

In this chapter, a historical overview as well as an overview of state of the art of the surgical techniques for the treatment of lung cancer is outlined. The chapter focuses on the introduction of open surgery, video-assisted thoracic surgery (VATS), uniportal VATS (UVATS), and robotic-assisted thoracic surgery (RATS) techniques for lung resections. A short introduction on upcoming techniques and modalities is given. The currently available tools as three-dimensional (3D) computed tomography (CT), virtual reality, and endo-bronchial surgery will be discussed. Based on the current development, this chapter attempts to delineate the horizon of oncological lung surgery. The information is generated not only from the available literature, but also from the experiences of surgeons and other physicians as well as co-workers involved in lung cancer treatment around the world. This chapter can be seen as a general introduction to several aspects of oncological lung surgery.

show abstract

“…Another advantage is that using MR glasses, also known as head-mounted displays (HMDs), a surgeon can consult a patient's data without touching real physical objects, such as a computer mouse, and therefore keeps his/her gloves sterile. Since the release of Microsoft's (Redmond, WA, USA) HoloLens HMD, in 2016, there has been a great effort to bring mixed reality (MR) into surgery [1][2][3][4][5][6][7][8][9][10][11]. However, we are still on an early stage to achieve the goal of bringing MR into a standard operating room to assist surgeons intraoperatively.…”

Section: Introductionmentioning

confidence: 99%

“…Using the HoloLens, previous research has mainly focused on projecting a virtual 3D model into a patient's body [8][9][10]13] or just above it to avoid obstructing a surgeon's line of sight [1]. The standard approach is to (1) obtain preoperative data from a patient using, for example, a CT scanner, (2) reconstruct a 3D model by segmenting the different slices of that CT scan using open-source software, such as 3DSlicer 1 or OsiriX, 2 (3) simplify that 3D model to contain only structures of interest for the specific surgery, and (iv) during surgery, align that simplified 3D model with the patient's body, usually through manual registration.…”

Section: Introductionmentioning

confidence: 99%

Multimodal mixed reality visualisation for intraoperative surgical guidance

et al. 2020

View full text Add to dashboard Cite

Purpose In the last decade, there has been a great effort to bring mixed reality (MR) into the operating room to assist surgeons intraoperatively. However, progress towards this goal is still at an early stage. The aim of this paper is to propose a MR visualisation platform which projects multiple imaging modalities to assist intraoperative surgical guidance. Methodology In this work, a MR visualisation platform has been developed for the Microsoft HoloLens. The platform contains three visualisation components, namely a 3D organ model, volumetric data, and tissue morphology captured with intraoperative imaging modalities. Furthermore, a set of novel interactive functionalities have been designed including scrolling through volumetric data and adjustment of the virtual objects’ transparency. A pilot user study has been conducted to evaluate the usability of the proposed platform in the operating room. The participants were allowed to interact with the visualisation components and test the different functionalities. Each surgeon answered a questionnaire on the usability of the platform and provided their feedback and suggestions. Results The analysis of the surgeons’ scores showed that the 3D model is the most popular MR visualisation component and neurosurgery is the most relevant speciality for this platform. The majority of the surgeons found the proposed visualisation platform intuitive and would use it in their operating rooms for intraoperative surgical guidance. Our platform has several promising potential clinical applications, including vascular neurosurgery. Conclusion The presented pilot study verified the potential of the proposed visualisation platform and its usability in the operating room. Our future work will focus on enhancing the platform by incorporating the surgeons’ suggestions and conducting extensive evaluation on a large group of surgeons.

show abstract

Clinical Feasibility of a Wearable Mixed-Reality Device in Neurosurgery

Cited by 152 publications

References 16 publications

A hand‐eye calibration method for augmented reality applied to computer‐assisted orthopedic surgery

A hand‐eye calibration method for augmented reality applied to computer‐assisted orthopedic surgery

The Realm of Oncological Lung Surgery: From Past to Present and Future Perspectives

Multimodal mixed reality visualisation for intraoperative surgical guidance

Contact Info

Product

Resources

About