Development of augmented‐reality applications in otolaryngology–head and neck surgery

Rose, Austin S.; Kim, Hyounghun; Fuchs, Henry; Frahm, Jan‐Michael

doi:10.1002/lary.28098

Cited by 41 publications

(42 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Mean vertex and centroid position errors were up to 5 mm (Table 1). These findings are in line with the results of a systematic review which explored AR-guided open surgery [20] and with previous studies using holographic headsets [28][29][30][31][32]. A non-negligible percentage of cases (24-30% approximately) presented positional errors over 2 mm (Table 2).…”

Section: Error In the Position And Dimensions Of The Virtual Modelssupporting

confidence: 90%

Effect of marker position and size on the registration accuracy of HoloLens in a non-clinical setting with implications for high-precision surgical tasks

et al. 2021

View full text Add to dashboard Cite

Purpose Emerging holographic headsets can be used to register patient-specific virtual models obtained from medical scans with the patient’s body. Maximising accuracy of the virtual models’ inclination angle and position (ideally, ≤ 2° and ≤ 2 mm, respectively, as in currently approved navigation systems) is vital for this application to be useful. This study investigated the accuracy with which a holographic headset registers virtual models with real-world features based on the position and size of image markers. Methods HoloLens® and the image-pattern-recognition tool Vuforia Engine™ were used to overlay a 5-cm-radius virtual hexagon on a monitor’s surface in a predefined position. The headset’s camera detection of an image marker (displayed on the monitor) triggered the rendering of the virtual hexagon on the headset’s lenses. 4 × 4, 8 × 8 and 12 × 12 cm image markers displayed at nine different positions were used. In total, the position and dimensions of 114 virtual hexagons were measured on photographs captured by the headset’s camera. Results Some image marker positions and the smallest image marker (4 × 4 cm) led to larger errors in the perceived dimensions of the virtual models than other image marker positions and larger markers (8 × 8 and 12 × 12 cm). ≤ 2° and ≤ 2 mm errors were found in 70.7% and 76% of cases, respectively. Conclusion Errors obtained in a non-negligible percentage of cases are not acceptable for certain surgical tasks (e.g. the identification of correct trajectories of surgical instruments). Achieving sufficient accuracy with image marker sizes that meet surgical needs and regardless of image marker position remains a challenge.

show abstract

Section: Error In the Position And Dimensions Of The Virtual Modelssupporting

confidence: 90%

Effect of marker position and size on the registration accuracy of HoloLens in a non-clinical setting with implications for high-precision surgical tasks

et al. 2021

View full text Add to dashboard Cite

show abstract

“…However, nausea, vertigo and headache have been reported with VR in 30-80% of the users, depending on the software [8,9]. VR surgical planning is gaining increasing attention since it has been shown to augment operative accuracy, efficiency and outcomes [10][11][12]. However, there are only very few independent studies, which investigate the validity and accuracy of VR in authentic settings [13].…”

Section: Electronic Supplementary Materialsmentioning

confidence: 99%

“…VR surgical planning is gaining increasing attention since it has been shown to augment operative accuracy, efficiency and outcomes [ 10 – 12 ]. However, there are only very few independent studies, which investigate the validity and accuracy of VR in authentic settings [ 13 ].…”

Section: Introductionmentioning

confidence: 99%

Virtual reality improves the accuracy of simulated preoperative planning in temporal bones: a feasibility and validation study

Timonen

Iso-Mustajärvi

Linder

et al. 2020

Eur Arch Otorhinolaryngol

View full text Add to dashboard Cite

Purpose Consumer-grade virtual reality (VR) has recently enabled various medical applications, but more evidence supporting their validity is needed. We investigated the accuracy of simulated surgical planning in a VR environment (VR) with temporal bones and compared it to conventional cross-sectional image viewing in picture archiving and communication system (PACS) interface. Methods Five experienced otologic surgeons measured significant anatomic structures and fiducials on five fresh-frozen cadaveric temporal bones in VR and cross-sectional viewing. Primary image data were acquired by computed tomography. In total, 275 anatomical landmark measurements and 250 measurements of the distance between fiducials were obtained with both methods. Distance measurements between the fiducials were confirmed by physical measurement obtained by Vernier caliper. The experts evaluated the subjective validity of both methods on a 5-point Likert scale qualitative survey. Results A strong correlation based on intraclass coefficient was found between the methods on both the anatomical (r > 0.900) and fiducial measurements (r > 0.916). Two-tailed paired t-test and Bland–Altman plots demonstrated high equivalences between the VR and cross-sectional viewing with mean differences of 1.9% (p = 0.396) and 0.472 mm (p = 0.065) for anatomical and fiducial measurements, respectively. Gross measurement errors due to the misidentification of fiducials occurred more frequently in the cross-sectional viewing. The mean face and content validity rating for VR were significantly better compared to cross-sectional viewing (total mean score 4.11 vs 3.39, p < 0.001). Conclusion Our study supports good accuracy and reliability of VR environment for simulated surgical planning in temporal bones compared to conventional cross-sectional visualization.

show abstract

“…To improve accurate localization and intraoperative 3D visualization, Rose et al 12 . have proposed the AR system by enhancing the iterative closest algorithm for on‐patient medical image visualization.…”

Section: Literature Reviewmentioning

confidence: 99%

A novel visualization system of using augmented reality in knee replacement surgery: Enhanced bidirectional maximum correntropy algorithm

Maharjan

Alsadoon

Prasad

et al. 2021

Robotics Computer Surgery

View full text Add to dashboard Cite

Background and Aim Image registration and alignment are the main limitations of augmented reality (AR)‐based knee replacement surgery. This research aims to decrease the registration error, eliminate outcomes that are trapped in local minima to improve the alignment problems, handle the occlusion and maximize the overlapping parts. Methodology Markerless image registration method was used for AR‐based knee replacement surgery to guide and visualize the surgical operation. While weight least square algorithm was used to enhance stereo camera‐based tracking by filling border occlusion in right‐to‐left direction and non‐border occlusion from left‐to‐right direction. Results This study has improved video precision to 0.57–0.61 mm alignment error. Furthermore, with the use of bidirectional points, that is, forward and backward directional cloud point, the iteration on image registration was decreased. This has led to improve the processing time as well. The processing time of video frames was improved to 7.4–11.74 frames per second. Conclusions It seems clear that this proposed system has focused on overcoming the misalignment difficulty caused by the movement of patient and enhancing the AR visualization during knee replacement surgery. The proposed system was reliable and favourable which helps in eliminating alignment error by ascertaining the optimal rigid transformation between two cloud points and removing the outliers and non‐Gaussian noise. The proposed AR system helps in accurate visualization and navigation of anatomy of knee such as femur, tibia, cartilage, blood vessels and so forth.

show abstract

Development of augmented‐reality applications in otolaryngology–head and neck surgery

Cited by 41 publications

References 32 publications

Effect of marker position and size on the registration accuracy of HoloLens in a non-clinical setting with implications for high-precision surgical tasks

Effect of marker position and size on the registration accuracy of HoloLens in a non-clinical setting with implications for high-precision surgical tasks

Virtual reality improves the accuracy of simulated preoperative planning in temporal bones: a feasibility and validation study

A novel visualization system of using augmented reality in knee replacement surgery: Enhanced bidirectional maximum correntropy algorithm

Contact Info

Product

Resources

About