A recent review and a taxonomy for hard and soft tissue visualization‐based mixed reality

Abstract

Background: Mixed reality (MR) visualization is gaining popularity in image-guided surgery (IGS) systems, especially for hard and soft tissue surgeries. However, a few MR systems are implemented in real time. Some factors are limiting MR technology and creating a difficulty in setting up and evaluating the MR system in real environments. Some of these factors include: the end users are not considered, the limitations in the operating room, and the medical images are not fully unified into the operating interventions. Methodology: The purpose of this article is to use Data, Visualization processing, and View (DVV) taxonomy to evaluate the current MR systems. DVV includes all the components required to be considered and validated for the MR used in hard and soft tissue surgeries. This taxonomy helps the developers and end users like researchers and surgeons to enhance MR system for the surgical field. Results: We evaluated, validated, and verified the taxonomy based on system comparison, completeness, and acceptance criteria. Around 24 state-of-the-art solutions that are picked relate to MR visualization, which is then used to demonstrate and validate this taxonomy. The results showed that most of the findings are evaluated and others are validated. Conclusion: The DVV taxonomy acts as a great resource for MR visualization in IGS. State-of-the-art solutions are classified, evaluated, validated, and verified to elaborate the process of MR visualization during surgery. The DVV taxonomy provides the benefits to the end users and future improvements in MR.

Mesoscopic fluorescence lifetime imaging: Fundamental principles, clinical applications and future directions

“…The incorporation of an aiming beam to track the measurement location permits real‐time display of individual or combined FLIm parameters superimposed to an image of the surgical field‐of‐view for an augmented reality visualization experience [110, 118]. For applications where the current standard of care does not require an imaging system (ie, cameras), mixed‐reality visualization approaches with goggles or ancillary screens could enable enhanced surgical guidance [232–237].…”

Mixed Reality Platforms in Telehealth Delivery: Scoping Review

“…This aspect of telesurgery has been experimented with as a visualization opportunity using smartphone-delivered vision and VR headsets to perform microsurgery for cataract and phacoemulsification [140]. In addition, Stereoscopic AR Predictive Display using the da Vinci R Surgical System to perform laparoscopic surgery and AR-assisted robotic surgery for kidney transplant procedures are some of the current practical applications of telesurgery [141][142][143]. Telediagnosis refers to the detection or evaluation of a disease or condition using telematics technology.…”