Augmented reality visualization of deformable tubular structures for surgical simulation

Ferrari, Vincenzo; Viglialoro, Rosanna Maria; Nicoli, Paola; Cutolo, Fabrizio; Condino, Sara; Carbone, Marina; Siesto, Mentore; Ferrari, Mauro

doi:10.1002/rcs.1681

Cited by 30 publications

(51 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In particularly the AR-Sim includes patient-specific physical replicas of: liver, gallbladder, pancreas, abdominal aorta, stomach, duodenum (fabricated as described in [9,10]) and realistic physical replicas of biliary ducts, arterial tree and connective tissue (fabricated as described in [9,10]). All the anatomical replicas match the shape, geometry and consistency of real human organs to enable a realistic interaction between the surgical tools/surgeon hand and the simulated anatomy (Fig.…”

Section: Augmented Reality Simulator (Ar-sim) For Laparoscopic Cholecmentioning

confidence: 99%

“…This paper presents a proof-of-concept implementation of the aforementioned approach for the simulation of artery pulse palpation. The system is based on the integration of a wearable haptic device into an augmented physical simulation platform allowing the real time tracking and augmented reality visualization of deformable tubular structures [9,10]. In particular, we propose a method to accurately track the arterial replicas and the user finger [11] and to provide pulse feedback during palpation through a wearable haptic device.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Tactile Augmented Reality for Arteries Palpation in Open Surgery Training

Condino

Viglialoro

Fani

et al. 2016

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Palpation is an essential step of several open surgical procedures for locating arteries by arterial pulse detection. In this context, surgical simulation would ideally provide realistic haptic sensations to the operator. This paper presents a proof of concept implementation of tactile augmented reality for open-surgery training. The system is based on the integration of a wearable tactile device into an augmented physical simulator which allows the real time tracking of artery reproductions and the user finger and provides pulse feedback during palpation. Preliminary qualitative test showed a general consensus among surgeons regarding the realism of the arterial pulse feedback and the usefulness of tactile augmented reality in open-surgery simulators

show abstract

Section: Augmented Reality Simulator (Ar-sim) For Laparoscopic Cholecmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Tactile Augmented Reality for Arteries Palpation in Open Surgery Training

Condino

Viglialoro

Fani

et al. 2016

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

show abstract

“…Similarly, we also measured the values of the subtended angular error (α err ). Then, knowing the overlay error in pixels and given the distance z ß C and the focal length of the viewpoint camera f C , we also computed the associated absolute error in mm at the validation checkerboard plane by using the following relation: [32,33]: Table 1 shows the results of the eight calibrations in terms of overlay error (o err 2D ), angular error (α err ), and absolute error (a err 3D ). The overall mean, standard deviation, and max values of o err 2D were 2.23, 0.96, and 5.03 px; the same values for α err were 5.98, 2.58, and 13.47 arcmin and for a err The average overlay error for the reference position was comparable to that obtained by Owen et al [14] and by Gilson et al [16], whereas for the remaining positions, the average overlay error was comparable to that obtained in [9] and in [8].…”

Section: Quantitative Evaluation Of Virtual-to-real Registration Accumentioning

confidence: 99%

Off-Line Camera-Based Calibration for Optical See-Through Head-Mounted Displays

et al. 2019

Self Cite

View full text Add to dashboard Cite

In recent years, the entry into the market of self contained optical see-through headsets with integrated multi-sensor capabilities has led the way to innovative and technology driven augmented reality applications and has encouraged the adoption of these devices also across highly challenging medical and industrial settings. Despite this, the display calibration process of consumer level systems is still sub-optimal, particularly for those applications that require high accuracy in the spatial alignment between computer generated elements and a real-world scene. State-of-the-art manual and automated calibration procedures designed to estimate all the projection parameters are too complex for real application cases outside laboratory environments. This paper describes an off-line fast calibration procedure that only requires a camera to observe a planar pattern displayed on the see-through display. The camera that replaces the user’s eye must be placed within the eye-motion-box of the see-through display. The method exploits standard camera calibration and computer vision techniques to estimate the projection parameters of the display model for a generic position of the camera. At execution time, the projection parameters can then be refined through a planar homography that encapsulates the shift and scaling effect associated with the estimated relative translation from the old camera position to the current user’s eye position. Compared to classical SPAAM techniques that still rely on the human element and to other camera based calibration procedures, the proposed technique is flexible and easy to replicate in both laboratory environments and real-world settings.

show abstract

“…Concerning the MIS, the AR is used as a back up for two major drawbacks of the technique: the reduced visibility and in the case of robot-assisted MIS the loss of haptic feedback during the operation [38] . Thanks to AR, it is now possible to provide the surgeon with additional information such as the position of tumors [15,16] or blood vessels [11,15] . Modifications in the organ topology due to cuts can even be taken into account [40] .…”

Section: Introductionmentioning

confidence: 99%

A model order reduction approach to create patient-specific mechanical models of human liver in computational medicine applications

Lauzeral

Borzacchiello

Kugler

et al. 2019

Computer Methods and Programs in Biomedicine

View full text Add to dashboard Cite

et al.. A model order reduction approach to create patient-specific mechanical models of human liver in computational medicine applications.. Computer Methods and Programs in Biomedicine, Elsevier, 2019, 170, pp.a b s t r a c tBackground and objective: This paper focuses on computer simulation aspects of Digital Twin models in the medical framework. In particular, it addresses the need of fast and accurate simulators for the mechanical response at tissue and organ scale and the capability of integrating patient-specific anatomy from medical images to pinpoint the individual variations from standard anatomical models. Methods:We propose an automated procedure to create mechanical models of the human liver with patient-specific geometry and real time capabilities. The method hinges on the use of Statistical Shape Analysis to extract the relevant anatomical features from a database of medical images and Model Order Reduction to compute an explicit parametric solution for the mechanical response as a function of such features. The Sparse Subspace Learning, coupled with a Finite Element solver, was chosen to create lowrank solutions using a non-intrusive sparse sampling of the feature space.Results: In the application presented in the paper, the statistical shape model was trained on a database of 385 three dimensional liver shapes, extracted from medical images, in order to create a parametrized representation of the liver anatomy. This parametrization and an additional parameter describing the breathing motion in linear elasticity were then used as input in the reduced order model. Results show a consistent agreement with the high fidelity Finite Element models built from liver images that were excluded from the training dataset. However, we evidence in the discussion the difficulty of having compact shape parametrizations arising from the extreme variability of the shapes found in the dataset and we propose potential strategies to tackle this issue. Conclusions:A method to represent patient-specific real-time liver deformations during breathing is proposed in linear elasticity. Since the proposed method does not require any adaptation to the direct Finite Element solver used in the training phase, the procedure can be easily extended to more complex nonlinear constitutive behaviors -such as hyperelasticity -and more general load cases. Therefore it can be integrated with little intrusiveness to generic simulation software including more sophisticated and realistic models.

show abstract

Augmented reality visualization of deformable tubular structures for surgical simulation

Abstract: The alignment accuracy obtained demonstrates the feasibility of the approach, which can be adopted in advanced AR simulations, in particular as an aid to the identification and isolation of tubular structures. Copyright © 2015 John Wiley & Sons, Ltd.

Cited by 30 publications

References 41 publications

Tactile Augmented Reality for Arteries Palpation in Open Surgery Training

Tactile Augmented Reality for Arteries Palpation in Open Surgery Training

Off-Line Camera-Based Calibration for Optical See-Through Head-Mounted Displays

A model order reduction approach to create patient-specific mechanical models of human liver in computational medicine applications

Contact Info

Product

Resources

About