Mixed Reality application for surgical Planning in Video-Assisted Pulmonary Lobectomy

Abstract

INTRODUCTION The adoption of surgical planning systems could greatly simplify the performance of video-assisted thoracoscopic surgery and improve its safety. MATERIAL AND METHODS A new application for surgical planning in video-assisted thoracoscopic surgery was developed, making use of the HoloLens (v1) mixed reality device. The information was displayed in the form of interactive holograms, by means of gestural, visual or voice control. The application was validated during a video-assisted right upper lobectomy surgery, including systematic lymphadenectomy for squamous cell carcinoma in the right upper lobe. RESULTS No complications were shown during surgery. Prior to surgery, the system allowed the surgeon to access in real time the patient's medical history, review the computed tomography study, and visualize and manipulate a 3D model of the lung with its respective vascular and bronchial elements, as well as the tumor to be removed. The surgeon’s vision using the device was easily shared with the rest of the surgical team. The surgeon placed the holographic models with the surgical planning information behind the field of view of the operating table for possible reference during the procedure. The weight and heat generated by the device were considered ergonomic aspects to be improved. CONCLUSIONS The system provides real-time access to important patient information for surgical planning during video-assisted lobectomy surgery, without losing the sterility of the surgical act. The surgeon's view can be shared for communication and learning purposes, as well as recorded for later review of surgical complications.