Mixed reality navigation training system for liver surgery based on a high‐definition human cross‐sectional anatomy data set

Abstract

Objectives This study aims to use the three‐dimensional (3D) mixed‐reality model of liver, entailing complex intrahepatic systems and to deeply study the anatomical structures and to promote the training, diagnosis and treatment of liver diseases. Methods Vascular perfusion human specimens were used for thin‐layer frozen milling to obtain liver cross‐sections. The 104‐megapixel‐high‐definition cross sectional data set was established and registered to achieve structure identification and manual segmentation. The digital model was reconstructed and data was used to print a 3D hepatic model. The model was combined with HoloLens mixed reality technology to reflect the complex relationships of intrahepatic systems. We simulated 3D patient specific anatomy for identification and preoperative planning, conducted a questionnaire survey, and evaluated the results. Results The 3D digital model and 1:1 transparent and colored model of liver established truly reflected intrahepatic vessels and their complex relationships. The reconstructed model imported into HoloLens could be accurately matched with the 3D model. Only 7.7% participants could identify accessory hepatic veins. The depth and spatial‐relationship of intrahepatic structures were better understandable for 92%. The 100%, 84.6%, 69% and 84% believed the 3D models were useful in planning, safer surgical paths, reducing intraoperative complications and training of young surgeons respectively. Conclusions A detailed 3D model can be reconstructed using the higher quality cross‐sectional anatomical data set. When combined with 3D printing and HoloLens technology, a novel hybrid‐reality navigation‐training system for liver surgery is created. Mixed Reality training is a worthy alternative to provide 3D information to clinicians and its possible application in surgery. This conclusion was obtained based on a questionnaire and evaluation. Surgeons with extensive experience in surgical operations perceived in the questionnaire that this technology might be useful in liver surgery, would help in precise preoperative planning, accurate intraoperative identification, and reduction of hepatic injury.

Bibliometric Analysis: Augmented Reality in Science Education Research Trends

“…The VOS Viewer offers bibliometric analysis mapping with three different visualizations, including the overlay visualization mentioned (see Figure 12). Based on Figure 12, Augmented Reality research is more related to clinical articles (Jeffers et al, 2022;Lau et al, 2023), extended reality (Chang et al, 2023;Gurses et al, 2023;Spadoni et al, 2022), likert scale (Soyka & Simons, 2022;Zatarain-Cabada et al, 2023), and nuclear magnetic resonance imaging (De Benedictis et al, 2023;Shahbaz et al, 2023). Additionally, Augmented Reality research is applied from early childhood education to higher education levels (Senduk et al, 2016).…”

The importance of preoperative imaging in living-donor hepatectomy

“…On the other hand, the surgical procedure for LDH is more and more turning towards to a minimally invasive approach especially with the robot assisted procedure. In this context, the “all in one” 3D imaging proposed by the authors combined with the new technologies such as virtual reality, augmented realty, mixed reality or extended reality will probably be the standard of care in upcoming years since the use of the information generated by 3D virtual scenarios in real-time surgery using increased reality technology will be rapidly developed ( 4 ). Different studies, already proposed minimally invasive liver surgeries assisted by virtual imaging.…”