A Patient-Specific Mixed-Reality Visualization Tool for Thoracic Surgical Planning

Artificial intelligence assisted display in thoracic surgery: development and possibilities

“…Wearing MR equipment, surgeons could control the holographic projection through gestures (Figure 2B,2C), which is beneficial for distinguishing the positional relationship between arteries, veins, and lesions (33). A prior study displayed that MR combined with a 3D printing navigational template can be feasible for precisely localizing pulmonary nodules (51,52). With this technology, the surgeon could remove the lesions under direct vision like the scientific movies show (Figure 2D-2F).…”

Augmented reality-assisted localization of solitary pulmonary nodules for precise sublobar lung resection: a preliminary study using an animal model

“…Incekara et al, applied HoloLens to 25 cases of brain tumor resection surgery, and the average margin of error was 4 mm, as measured with the traditional neurosurgery navigation system, BrainLab, as the standard control (26). Perkins et al reported that Mixed-reality visualization during surgical facilitate accurate and rapid identification of small lung lesions during minimally invasive surgeries and reduce the need for additional invasive preoperative localization procedures using Microsoft HoloLens as well (27).…”

Application of Mixed Reality in Medical Training and Surgical Planning Focused on Minimally Invasive Surgery

“…However, this application was not used during any actual surgery as a surgical planning tool, but only a pilot study with a phantom was used to collect data through a survey. Other MR solutions (with less functionality) were used retrospectively as surgical planning tools in patients undergoing thoracic surgery (Perkins et al, 2020). This application allowed the visualisation of only one of the three views of the preoperative imaging study, as well as the manipulation of 3D models obtained from it.…”

“…This opens up new possibilities, such as preoperative simulations, to determine optimal procedures and to predict the final surgical outcomes. MR technology has already been successfully applied as a planning tool in different surgical scenarios, including urology , thoracic surgery (Perkins et al, 2020), neurosurgery, colorectal, and bariatric surgery (Cartucho et al, 2020). These solutions allow for the inclusion of elaborate information such as holographic images or 3D objects that can be placed within the surgeon's field of view, thus avoiding the need to use alternative displays in the OR and facilitating a more precise alignment between virtual information and physical objects.…”