Mixed Reality Improves 3D Visualization and Spatial Awareness of Bone Tumors for Surgical Planning in Orthopaedic Oncology: A Proof of Concept Study

Abstract

In orthopedic oncology, computer navigation and 3D-printed guides facilitate precise osteotomies only after surgical exposure. Before surgeries start, it is challenging to mentally process and superimpose the virtual medical images onto patients' anatomy for preoperative surgical planning. Mixed Reality (MR) is an immersive technology merging real and virtual worlds, and users can interact with digital objects in real time. Through Head-Mounted Displays, surgeons directly visualize holographic models that overlaid on tumor patients. The technology may facilitate surgical planning before skin incisions. Methods: Nine bone tumor patients were included (July 2021 -Dec 2022). There were six primary bone sarcomas, two benign bone tumors, and one revision pelvic prosthesis. MR applications were created using patients' preoperative medical images. The surgeon examined each patient clinically using the conventional method of viewing 2D images and MR via HMD, Hololens 2. A Likert-Scale (LS) questionnaire and The National Aeronautics and Space Administration-Task Load Index (NASA-TLX) score were used to evaluate and compare the effectiveness of surgical planning and the surgeon's clinical cognitive workload for the two methods. Results:The qualitative survey of the LS questionnaire suggested that the MR group had superior spatial awareness of tumors and was considered more effective as a preoperative planning tool than the conventional group. For NASA-TLX scores, the overall cognitive workload was lower in MR 3D hologram group than in the 2D Group for preoperative clinical assessment. When using MR technology with HMDs, the surgeon reported no discomfort. Conclusion: MR technology may improve 3D visualization and spatial awareness of bone tumors in patients' anatomies and may facilitate surgical planning before skin incisions in orthopedic oncology surgery. With less cognitive load and better ergonomics, surgeons can focus on patients and surgical tasks with MR technology. Further studies must investigate whether MR technology improves clinical outcomes.

The application of extended reality technology-assisted intraoperative navigation in orthopedic surgery

“…Any slight mistake in surgical planning or execution can result in residual tumor infiltration at the resection margin, increasing the risk of local recurrence and adversely affecting long-term patient survival ( 42 – 44 ). However, as XR provides superior spatial awareness of tumors and reduces the cognitive workload of surgeons, XR-technology-assisted intraoperative navigation techniques can help surgeons obtain a more intuitive visualization of tumors' boundaries ( 45 ). As a result, surgeons are more likely to achieve a surgical margin that is free of tumor infiltration.…”

Realistic Texture Mapping of 3D Medical Models Using RGBD Camera for Mixed Reality Applications

“…The use of these technologies in the industry is spreading, with applications being developed not only for entertainment and video games but also in many other areas, including medicine and surgery. The surgical areas where these technologies are being introduced are different: orthopaedic surgery [1][2][3][4][5][6], vascular surgery [7][8][9], oncology [10][11][12][13][14], neurosurgery [15][16][17][18] and maxillofacial surgery [19][20][21][22].…”