GPU-Based Visualization of Deformable Volumetric Soft-Tissue for Real-Time Simulation of Haptic Needle Insertion

Fortmeier, Dirk; Mastmeyer, André; Handels, Heinz

doi:10.1007/978-3-642-28502-8_22

Cited by 10 publications

(6 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To assess the quality and relevance of BB detection for patient modelling in VR simulators [54], [1], [2] thoroughly, we plan studies in our lab to examine the influence of different imaging modalities [55], [56], [57], [58], [59] and BB detection quality by VR visualization and interaction with detected BBs using haptic force feedback [60], [58], [61], [62], [63] for quality assurance. In the future, we will also address the accurate and precise BB detection and content segmentation [64] using nD image data from various imaging sources.…”

Section: Resultsmentioning

confidence: 99%

3D Bounding Box Detection in Volumetric Medical Image Data: A Systematic Literature Review

Kern

Mastmeyer

2020

Preprint

Self Cite

View full text Add to dashboard Cite

This paper discusses current methods and trends for 3D bounding box detection in volumetric medical image data. For this purpose, an overview of relevant papers from recent years is given. 2D and 3D implementations are discussed and compared. Multiple identified approaches for localizing anatomical structures are presented. The results show that most research recently focuses on Deep Learning methods, such as Convolutional Neural Networks vs. methods with manual feature engineering, e.g. Random-Regression-Forests. An overview of bounding box detection options is presented and helps researchers to select the most promising approach for their target objects.<br>

show abstract

Section: Resultsmentioning

confidence: 99%

3D Bounding Box Detection in Volumetric Medical Image Data: A Systematic Literature Review

Kern

Mastmeyer

2020

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…However, the evaluation framework and the presented results are simulation-software-based (in silico) in absence of in vivo and in vitro reference measurement data, which are also difficult to supply. Needle steering can not be assessed by axial forces and deformations [22][23][24] alone, and non-axial needle-tissue interaction forces are found along the entire embedded needle length. However, in our situation (axial punctures) the forces from breathing motion are mainly directed orthogonally to the needle insertion direction, so that they do not contribute saliently during needle advance.…”

Section: Discussionmentioning

confidence: 99%

Evaluation of Direct Haptic 4D Volume Rendering of Partially Segmented Data for Liver Puncture Simulation

Mastmeyer

Fortmeier

Handels

2017

Sci Rep

Self Cite

View full text Add to dashboard Cite

This work presents an evaluation study using a force feedback evaluation framework for a novel direct needle force volume rendering concept in the context of liver puncture simulation. PTC/PTCD puncture interventions targeting the bile ducts have been selected to illustrate this concept. The haptic algorithms of the simulator system are based on (1) partially segmented patient image data and (2) a non-linear spring model effective at organ borders. The primary aim is to quantitatively evaluate force errors caused by our patient modeling approach, in comparison to haptic force output obtained from using gold-standard, completely manually-segmented data. The evaluation of the force algorithms compared to a force output from fully manually segmented gold-standard patient models, yields a low mean of 0.12 N root mean squared force error and up to 1.6 N for systematic maximum absolute errors. Force errors were evaluated on 31,222 preplanned test paths from 10 patients. Only twelve percent of the emitted forces along these paths were affected by errors. This is the first study evaluating haptic algorithms with deformable virtual patients in silico. We prove haptic rendering plausibility on a very high number of test paths. Important errors are below just noticeable differences for the hand-arm system.

show abstract

“…Despite the earlier success of TLED in large deformation simulation, it has not been generalized to handle cutting simulation. Most recently, similar to diffusive regularization in image registration, Fortmeier et al [29] proposed to conduct volumetric soft tissue deformation by relaxing ChainMail algorithm on the inverse of the displacement field. However, it can only simulate local deformations caused by needle insertion.…”

Section: Volumetric Image Manipulationmentioning

confidence: 99%

Interactive deformation and cutting simulation directly using patient‐specific volumetric images

Ли

Zhao

Wang

et al. 2013

Computer Animation & Virtual

View full text Add to dashboard Cite

This paper systematically advocates an interactive volumetric image manipulation framework, which can enable the rapid deployment and instant utility of patient-specific medical images in virtual surgery simulation while requiring little user involvement. We seamlessly integrate multiple technical elements to synchronously accommodate physics-plausible simulation and high-fidelity anatomical structures visualization. Given a volumetric image, in a user-transparent way, we build a proxy to represent the geometrical structure and encode its physical state without the need of explicit 3-D reconstruction. On the basis of the dynamic update of the proxy, we simulate large-scale deformation, arbitrary cutting, and accompanying collision response driven by a non-linear finite element method. By resorting to the upsampling of the sparse displacement field resulted from non-linear finite element simulation, the cut/deformed volumetric image can evolve naturally and serves as a time-varying 3-D texture to expedite direct volume rendering. Moreover, our entire framework is built upon CUDA (Beihang University, Beijing, China) and thus can achieve interactive performance even on a commodity laptop. The implementation details, timing statistics, and physical behavior measurements have shown its practicality, efficiency, and robustness.

show abstract

GPU-Based Visualization of Deformable Volumetric Soft-Tissue for Real-Time Simulation of Haptic Needle Insertion

Cited by 10 publications

References 8 publications

3D Bounding Box Detection in Volumetric Medical Image Data: A Systematic Literature Review

3D Bounding Box Detection in Volumetric Medical Image Data: A Systematic Literature Review

Evaluation of Direct Haptic 4D Volume Rendering of Partially Segmented Data for Liver Puncture Simulation

Interactive deformation and cutting simulation directly using patient‐specific volumetric images

Contact Info

Product

Resources

About