Image‐guided transorbital procedures with endoscopic video augmentation

DeLisi, Michael P.; Mawn, Louise A.; Galloway, Robert L.

doi:10.1118/1.4892181

Cited by 4 publications

(4 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Unlike in other surgical fields, relatively few studies utilized AR for surgical guidance. 33 , 34 DeLisi et al 33 found that surgeons who used their video augmentation system experienced faster endoscopic procedural times than surgeons who did not use AR ( P = 0.020). Pan et al 34 developed and implemented a deep learning framework to accurately detect corneal contours for accurate suturing in deep anterior lamellar keratoplasty procedures.…”

Section: Resultsmentioning

confidence: 99%

“…Unlike in other surgical fields, relatively few studies utilized AR for surgical guidance 33,34 . DeLisi et al 33 found that surgeons who used their video augmentation system experienced faster endoscopic procedural times than surgeons who did not use AR ( P = 0.020).…”

Section: Resultsmentioning

confidence: 99%

“…Seven studies evaluated the use of VR and AR in clinical training as seen in Supplementary Digital Content, Table 2, http:// links.lww.com/APJO/A94. [32][33][34][35][36][37][38]…”

Section: Clinical Trainingmentioning

confidence: 99%

See 2 more Smart Citations

Virtual Reality and Augmented Reality in Ophthalmology: A Contemporary Prospective

Iskander

Ogunsola

Ramachandran

et al. 2021

Asia-Pacific Journal of Ophthalmology

View full text Add to dashboard Cite

Purpose: Most published systematic reviews have focused on the use of virtual reality (VR)/augmented reality (AR) technology in ophthalmology as it relates to surgical training. To date, this is the first review that investigates the current state of VR/AR technology applied more broadly to the entire field of ophthalmology. Methods: PubMed, Embase, and CINAHL databases were searched systematically from January 2014 through December 1, 2020. Studies that discussed VR and/or AR as it relates to the field of ophthalmology and provided information on the technology used were considered. Abstracts, non–peer-reviewed literature, review articles, studies that reported only qualitative data, and studies without English translations were excluded. Results: A total of 77 studies were included in this review. Of these, 28 evaluated the use of VR/AR in ophthalmic surgical training/assessment and guidance, 7 in clinical training, 23 in diagnosis/screening, and 19 in treatment/therapy. 15 studies used AR, 61 used VR, and 1 used both. Most studies focused on the validity and usability of novel technologies. Conclusions: Ophthalmology is a field of medicine that is well suited for the use of VR/AR. However, further longitudinal studies examining the practical feasibility, efficacy, and safety of such novel technologies, the cost-effectiveness, and medical/legal considerations are still needed. We believe that time will indeed foster further technological advances and lead to widespread use of VR/AR in routine ophthalmic practice.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

Virtual Reality and Augmented Reality in Ophthalmology: A Contemporary Prospective

Iskander

Ogunsola

Ramachandran

et al. 2021

Asia-Pacific Journal of Ophthalmology

View full text Add to dashboard Cite

show abstract

“…Accordingly there are various other specific approaches which we have assigned to the group of information support IGS, including systems providing intraoperative visualization of cumulative instrument positions corresponding to removed tissue providing the surgeon with information about the surgical process over time (process visualization, PV-IGS) (Hong et al, 2009;Voormolen et al, 2012;Woerdeman et al, 2009a), visualization of uncertainty arising from registration, instrument calibration and tracking (uncertainty visualization, UV-IGS) (Simpson et al, 2014), visualization of distances between the surgical instrument and sensitive anatomical structures that need to be protected during the surgery (distance visualization, DV-IGS) (Cho et al, 2013;Voormolen et al, 2012), auditory or visual alerts if the instrument approaches such a structure (proximity warnings, PW-IGS) (Cho et al, 2013;Dixon et al, 2014a;Voormolen et al, 2012;Willems et al, 2005;Woerdeman et al, 2009b), augmentation of risk structures included directly into the whole endoscopic video image or just on its background (augmented risk structures, ARS-IGS) (Dixon et al, 2012;Li et al, 2016), augmentation of target tissue included directly in the microscopic view (augmented target volume, ATV-IGS) (Woerdeman et al, 2009b), augmented cues for small targets (e.g. crosshair) included in the endoscopic video image (augmented target, AT-IGS) (DeLisi et al, 2014;DeLisi et al, 2015), augmented pathways which represent the best way to bring the instrument to a certain target area or tumor directly included in the endoscopic video image (augmented pathway, AP-IGS) (Caversaccio and Frysinger, 2003;Freysinger et al, 1997), or three-dimensional endoscopic virtual visualizations of anatomical structures (threedimensional virtual image guidance, 3DV-IGS) (Dixon et al, 2016;Dixon et al, 2014a).…”

Section: Igs System Functionalitiesmentioning

confidence: 99%

Impact of image-guided surgery on surgeons' performance: a literature review

Luz

Strauß²,

Manzey

2016

IJHFE

View full text Add to dashboard Cite

is a research scientist at the Computer-Assisted Surgery group in Otto-von-Guericke University Magdeburg. Her research addresses human-automation interaction in the medical field. She obtained a diploma in psychology from the Berlin Institute of Technology in 2008. In 2011 she has won the Human Factors Prize for Excellence for Human Factors/Ergonomics Research for her work about human factors issues of image-guided navigation systems. Currently she is a PhD candidate. The topic of her PhD thesis is "The impact of image-guided navigation with different degrees of automation on performance, workload and situation awareness of surgeons".

show abstract

Intraoperative Augmented Reality for Vitreoretinal Surgery using Edge Computing

Ye,

Iezzi

2024

Preprint

View full text Add to dashboard Cite

Purpose: Augmented reality (AR) may allow vitreoretinal surgeons to leverage microscope-integrated digital imaging systems to analyze and highlight key retinal anatomic features in real-time, possibly improving safety and precision during surgery. By employing convolutional neural networks (CNNs) for retina vessel segmentation, a retinal coordinate system can be created that allows pre-operative images of capillary non-perfusion or retinal breaks to be digitally aligned and overlayed upon the surgical field in real-time. Such technology may be useful in assuring thorough laser treatment of capillary non-perfusion or in using pre-operative optical coherence tomography (OCT) to guide macular surgery when microscope-integrated OCT (MIOCT) is not available. Methods: This study is a retrospective analysis involving the development and testing of a novel image registration algorithm for vitreoretinal surgery. Fifteen anonymized cases of pars plana vitrectomy with epiretinal membrane peeling, along with corresponding preoperative fundus photographs and optical coherence tomography (OCT) images, were retrospectively collected from the Mayo Clinic database. We developed a TPU (Tensor-Processing Unit)-accelerated CNN for semantic segmentation of retinal vessels from fundus photographs and subsequent real-time image registration in surgical video streams. An iterative patch-wise cross-correlation (IPCC) algorithm was developed for image registration, with a focus on optimizing processing speeds and maintaining high spatial accuracy. The primary outcomes measured were processing speed in frames per second (FPS) and the spatial accuracy of image registration, quantified by the Dice coefficient between registered and manually aligned images. Results: When deployed on an Edge TPU, the CNN model combined with our image registration algorithm processed video streams at a rate of 14 FPS, which is superior to processing rates achieved on other standard hardware configurations. The IPCC algorithm efficiently aligned pre-operative and intraoperative images, showing high accuracy in comparison to manual registration. Conclusion: This study demonstrates the feasibility of using TPU-accelerated CNNs for enhanced AR in vitreoretinal surgery.

show abstract

Image‐guided transorbital procedures with endoscopic video augmentation

Cited by 4 publications

References 29 publications

Virtual Reality and Augmented Reality in Ophthalmology: A Contemporary Prospective

Virtual Reality and Augmented Reality in Ophthalmology: A Contemporary Prospective

Impact of image-guided surgery on surgeons' performance: a literature review

Intraoperative Augmented Reality for Vitreoretinal Surgery using Edge Computing

Contact Info

Product

Resources

About