Realistic and interactive high‐resolution 4D environments for real‐time surgeon and patient interaction

Smith, Lyndon; Farooq, Abdul; Smith, Melvyn L.; Ivanov, Ivan; Orlando, Andrea

doi:10.1002/rcs.1761

Cited by 6 publications

(3 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The limitations of the present study include (1) Although it has been reported by some authors that the use of the 3D surgical scope improves depth perception and enhances intraoperative visualization of lesions compared with the use of the conventional 2D scope, there have been no large-scale or long-term studies published to support these findings. 17,28,29 The future availability of new technologies, such as the new platform of the Da Vinci-SP Robot (Intuitive Surgical), the new generation of the 3D high-definition laparoscopic vision system, 28 and further refinement of articulated instruments might lead to better surgical outcomes, it will be increasingly difficult to highlight any slight difference between 2D and 3D NIR-ICG.…”

Section: Discussionmentioning

confidence: 99%

Real three‐dimensional approach vs two‐dimensional camera with and without real‐time near‐infrared imaging with indocyanine green for detection of endometriosis: A case‐control study

Vizzielli

Cosentino

Raimondo

et al. 2020

Acta Obstet Gynecol Scand

View full text Add to dashboard Cite

Introduction The complete surgical removal of endometriosis lesions is not always feasible because some implants may be very small or hidden. The use of intraoperative near‐infrared radiation (NIR) imaging after intravenous injection of indocyanine green (ICG) coupled with robotic technical advances, including three‐dimensional (3D) and high‐resolution vision, might improve detection rates. Material and methods This is a retrospective, multicenter case‐control study (Canadian Task Force classification II‐2) on medical records of women with endometriosis who underwent surgery at the Catholic University of Rome (Controls) and the University of Bologna (Cases) between January 2016 and March 2018. Surgical and post‐surgical data from the procedures were collected. We compared the visual detection rate of endometriotic lesions using near‐infrared radiation imaging after intravenous injection of indocyanine green (NIR‐ICG) in Real 3D (Cases) with the 2D Camera approach (Controls) in symptomatic women with pelvic endometriosis. Results Twenty cases were matched as closely as possible with 27 controls. The numbers of suspected lesions identified both with the white light and the NIR‐ICG approach were 116 and 70 in the Controls (2D) and Cases (3D), respectively. Among them, 16 of 116 controls (13.8%) and 12 of 70 cases (17.1%) were identified using only NIR‐ICG imaging and collected as occult lesions (P = .536). The overall NIR‐ICG lesion identification showed a positive predictive value of 97.8%, negative predictive value of 82.3%, sensitivity of 82.0%, and specificity of 97.9% for the Control group, and a positive predictive value of 100%, negative predictive value of 97.1%, sensitivity of 97.1%, and specificity of 100% for the Case group, confirming that NIR‐ICG imaging is a good diagnostic and screening test (P = .643 and P = .791, according to the Cohen κ tests, respectively for the laparoscopic and robotic groups). Conclusions The few differences observed did not seem to be clinically relevant, making the 2 procedures comparable in terms of the ability to visually detect endometriotic lesions. Further prospective trials are needed to confirm our results.

show abstract

Section: Discussionmentioning

confidence: 99%

Real three‐dimensional approach vs two‐dimensional camera with and without real‐time near‐infrared imaging with indocyanine green for detection of endometriosis: A case‐control study

Vizzielli

Cosentino

Raimondo

et al. 2020

Acta Obstet Gynecol Scand

View full text Add to dashboard Cite

show abstract

“…Also, the resolution is very low (1268 × 720) and the integration of artificial intelligence does not make any difference. References 39,41,43,44,47,48,79,and 86‐89 used different screens, PCs, or monitors to view the data along with other devices like iPad, projectors, and camera. Different from all these, Zhao et al 9 used a glasses‐free polyhedron‐shaped display device for telesurgical guidance.…”

Section: Discussionmentioning

confidence: 99%

A recent review and a taxonomy for hard and soft tissue visualization‐based mixed reality

Tuladhar

AlSallami

Alsadoon

et al. 2020

Robotics Computer Surgery

View full text Add to dashboard Cite

Background: Mixed reality (MR) visualization is gaining popularity in image-guided surgery (IGS) systems, especially for hard and soft tissue surgeries. However, a few MR systems are implemented in real time. Some factors are limiting MR technology and creating a difficulty in setting up and evaluating the MR system in real environments. Some of these factors include: the end users are not considered, the limitations in the operating room, and the medical images are not fully unified into the operating interventions. Methodology: The purpose of this article is to use Data, Visualization processing, and View (DVV) taxonomy to evaluate the current MR systems. DVV includes all the components required to be considered and validated for the MR used in hard and soft tissue surgeries. This taxonomy helps the developers and end users like researchers and surgeons to enhance MR system for the surgical field. Results: We evaluated, validated, and verified the taxonomy based on system comparison, completeness, and acceptance criteria. Around 24 state-of-the-art solutions that are picked relate to MR visualization, which is then used to demonstrate and validate this taxonomy. The results showed that most of the findings are evaluated and others are validated. Conclusion: The DVV taxonomy acts as a great resource for MR visualization in IGS. State-of-the-art solutions are classified, evaluated, validated, and verified to elaborate the process of MR visualization during surgery. The DVV taxonomy provides the benefits to the end users and future improvements in MR.

show abstract

“…Although VR technology has been applied in clinical applications such as surgery 22,23,56 , the insufficient spatial and temporal resolution of magnetic resonance imaging (MRI) and computed tomography (CT) has limited the uncovering of underlying physiological mechanisms of moving structures in live animal models 58,62 . In this context, we sought to address the temporal dependence of structural deformations to recapitulate the dynamics of developmental cardiac physiology.…”

Section: Introductionmentioning

confidence: 99%

Simulating Developmental Cardiac Morphology in Virtual Reality Using a Deformable Image Registration Approach

et al. 2018

View full text Add to dashboard Cite

While virtual reality (VR) has potential in enhancing cardiovascular diagnosis and treatment, prerequisite labor-intensive image segmentation remains an obstacle for seamlessly simulating 4-dimensional (4-D, 3-D + time) imaging data in an immersive, physiological VR environment. We applied deformable image registration (DIR) in conjunction with 3-D reconstruction and VR implementation to recapitulate developmental cardiac contractile function from light-sheet fluorescence microscopy (LSFM). This method addressed inconsistencies that would arise from independent segmentations of time-dependent data, thereby enabling the creation of a VR environment that fluently simulates cardiac morphological changes. By analyzing myocardial deformation at high spatiotemporal resolution, we interfaced quantitative computations with 4-D VR. We demonstrated that our LSFM-captured images, followed by DIR, yielded average dice similarity coefficients of 0.92 ± 0.05 (n = 510) and 0.93 ± 0.06 (n = 240) when compared to ground truth images obtained from Otsu thresholding and manual segmentation, respectively. The resulting VR environment simulates a wide-angle zoomed-in view of motion in live embryonic zebrafish hearts, in which the cardiac chambers are undergoing structural deformation throughout the cardiac cycle. Thus, this technique allows for an interactive micro-scale VR visualization of developmental cardiac morphology to enable high resolution simulation for both basic and clinical science.

show abstract

Realistic and interactive high‐resolution 4D environments for real‐time surgeon and patient interaction

Cited by 6 publications

References 24 publications

Real three‐dimensional approach vs two‐dimensional camera with and without real‐time near‐infrared imaging with indocyanine green for detection of endometriosis: A case‐control study

Real three‐dimensional approach vs two‐dimensional camera with and without real‐time near‐infrared imaging with indocyanine green for detection of endometriosis: A case‐control study

A recent review and a taxonomy for hard and soft tissue visualization‐based mixed reality

Simulating Developmental Cardiac Morphology in Virtual Reality Using a Deformable Image Registration Approach

Contact Info

Product

Resources

About