Photo-Realistic Tissue Reflectance Modelling for Minimally Invasive Surgical Simulation

ElHelw, Mohamed; Atkins, Stella; Nicolaou, Marios; Chung, Adrian J.; Yang, Guang‐Zhong

doi:10.1007/11566465_107

Cited by 5 publications

(7 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Therefore, a normal map disrupts the specular component computing, while an additional texture map produces colour for blending with the surface original colour, in real time (see Figure ). In 2005, this technique was evaluated by a group of naive volunteers and experts surgeons in a bronchoscopy surgery context [E*05]. The visual results show improvements when compared with standard Phong‐like models for organic tissue representation.…”

Section: General Approachesmentioning

confidence: 99%

See 1 more Smart Citation

Appearance Modelling of Living Human Tissues

Nunes

Maciel

Meyer³

et al. 2019

Computer Graphics Forum

View full text Add to dashboard Cite

The visual fidelity of realistic renderings in Computer Graphics depends fundamentally upon how we model the appearance of objects resulting from the interaction between light and matter reaching the eye. In this paper, we survey the research addressing appearance modelling of living human tissue. Among the many classes of natural materials already researched in Computer Graphics, living human tissues such as blood and skin have recently seen an increase in attention from graphics research. There is already an incipient but substantial body of literature on this topic, but we also lack a structured review as presented here. We introduce a classification for the approaches using the four types of human tissues as classifiers. We show a growing trend of solutions that use first principles from Physics and Biology as fundamental knowledge upon which the models are built. The organic quality of visual results provided by these Biophysical approaches is mainly determined by the optical properties of biophysical components interacting with light. Beyond just picture making, these models can be used in predictive simulations, with the potential for impact in many other areas.

show abstract

Section: General Approachesmentioning

confidence: 99%

“…A standard texture rendering with Blinn–Phong lighting model (left) and a result computed by roughness and mucous layer colour mapping (right). Source: [E*05].…”

Section: General Approachesmentioning

confidence: 99%

Appearance Modelling of Living Human Tissues

Nunes

Maciel

Meyer³

et al. 2019

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…The coefficients of the function are determined by constraining to satisfy the interpolation conditions and solving the following linear system of equations: (9) where , and is a matrix with the deformed points. Intuitively, measures the effect of the th control point on the transformation at the th control point.…”

Section: Mesh Warping Using Radial Basis Functions (Rbfs)mentioning

confidence: 99%

“…To overcome this problem, the reliance on patient specific data for building anatomical models both in terms of biomechanical fidelity and photorealism has attracted extensive interests in recent years [6], [7]. Existing work has already demonstrated that by fusing real-bronchoscopy video with three-dimensional (3-D) tomographic data of the same patient, it is possible to generate photorealistic models that allow high fidelity, patient specific bronchoscope simulation [8], [9].…”

Section: Introductionmentioning

confidence: 99%

Nonrigid 2-D/3-D Registration for Patient Specific Bronchoscopy Simulation With Statistical Shape Modeling: Phantom Validation

Deligianni

Chung

Yang³

2006

IEEE Trans. Med. Imaging

View full text Add to dashboard Cite

This paper presents a nonrigid registration two-dimensional/three-dimensional (2-D/3-D) framework and its phantom validation for subject-specific bronchoscope simulation. The method exploits the recent development of five degrees-of-freedom miniaturized catheter tip electromagnetic trackers such that the position and orientation of the bronchoscope can be accurately determined. This allows the effective recovery of unknown camera rotation and airway deformation, which is modelled by an active shape model (ASM). ASM captures the intrinsic variability of the tracheo-bronchial tree during breathing and it is specific to the class of motion it represents. The method reduces the number of parameters that control the deformation, and thus greatly simplifies the optimisation procedure. Subsequently, pq-based registration is performed to recover both the camera pose and parameters of the ASM. Detailed assessment of the algorithm is performed on a deformable airway phantom, with the ground truth data being provided by an additional six degrees-of-freedom electromagnetic (EM) tracker to monitor the level of simulated respiratory motion.

show abstract

“…Jensen et al [15] use a subsurface scattering model with a raytracer to achieve good results. ElHelw et al [16] describe their method in improving realism with polygonal models in a surgical simulation, which highlights the importance of using specular variation with multitexturing to provide a more natural looking wet surface, which in their case is tissue with a thin, transparent mucus as seen through a bronchoscope.…”

Section: Related Workmentioning

confidence: 99%

Enhancing Realism of Wet Surfaces in Temporal Bone Surgical Simulation

Kerwin

Shen

Stredney

2009

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

We present techniques to improve visual realism in an interactive surgical simulation application: a mastoidectomy simulator that offers a training environment for medical residents as a complement to using a cadaver. As well as displaying the mastoid bone through volume rendering, the simulation allows users to experience haptic feedback and appropriate sound cues while controlling a virtual bone drill and suction/irrigation device. The techniques employed to improve realism consist of a fluid simulator and a shading model. The former allows for deformable boundaries based on volumetric bone data, while the latter gives a wet look to the rendered bone to emulate more closely the appearance of the bone in a surgical environment. The fluid rendering includes bleeding effects, meniscus rendering, and refraction. We incorporate a planar computational fluid dynamics simulation into our three-dimensional rendering to effect realistic blood diffusion. Maintaining real-time performance while drilling away bone in the simulation is critical for engagement with the system.

show abstract

Photo-Realistic Tissue Reflectance Modelling for Minimally Invasive Surgical Simulation

Cited by 5 publications

References 14 publications

Appearance Modelling of Living Human Tissues

Appearance Modelling of Living Human Tissues

Nonrigid 2-D/3-D Registration for Patient Specific Bronchoscopy Simulation With Statistical Shape Modeling: Phantom Validation

Enhancing Realism of Wet Surfaces in Temporal Bone Surgical Simulation

Contact Info

Product

Resources

About