Virtual interaction and visualisation of 3D medical imaging data with VTK and Unity

Wheeler, Gavin; Deng, Shujie; Toussaint, Nicolas; Pushparajah, Kuberan; Schnabel, Julia A.; Simpson, John; Gómez, Alberto

doi:10.1049/htl.2018.5064

Cited by 55 publications

(41 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Therefore, to develop and deploy VR with a robust, distinct utility for the scientist, the present study successfully compared completely independent graders for the validation of diameter measurements in the physical and digital VR world. It was shown that VR can be used not only as an emerging method for qualitative image visualization of medical image data 17 , but that quantitative diameter measurements in VR were valid, highly reliable, repeatable and more uniform when compared to physical world measurements 18 .…”

Section: Discussionmentioning

confidence: 99%

Validation of virtual reality orbitometry bridges digital and physical worlds

Maloca

Faludi

Żelechowski

et al. 2020

Sci Rep

View full text Add to dashboard Cite

Clinical science and medical imaging technology are traditionally displayed in two dimensions (2D) on a computer monitor. In contrast, three-dimensional (3D) virtual reality (VR) expands the realm of 2D image visualization, enabling an immersive VR experience with unhindered spatial interaction by the user. Thus far, analysis of data extracted from VR applications was mainly qualitative. In this study, we enhance VR and provide evidence for quantitative VR research by validating digital VR display of computed tomography (CT) data of the orbit. Volumetric CT data were transferred and rendered into a VR environment. Subsequently, seven graders performed repeated and blinded diameter measurements. the intergrader variability of the measurements in VR was much lower compared to measurements in the physical world and measurements were reasonably consistent with their corresponding elements in the real context. The overall VR measurements were 5.49% higher. As such, this study attests the ability of VR to provide similar quantitative data alongside the added benefit of VR interfaces. VR entails a lot of potential for the future research in ophthalmology and beyond in any scientific field that uses three-dimensional data. Orbital tumors can either be primary, arising from structures within the orbit, or secondary, due to metastatic spread of a primary tumor elsewhere 1-3. A myriad of clinical findings suggest the presence of an orbital mass, namely proptosis, diplopia, pain, conjunctival congestion and varying degrees of visual loss 4,5. Diagnosis relies on adequate clinical examination and orbital imaging like magnetic resonance imaging (MRI) and/or computed tomography (CT) 6. Despite the great progress in medical imaging, the diagnosis of orbital lesions based on neuroimaging features may lack characteristic imaging features. Often, the diagnosis of specific orbital disorders such as Graves' disease associated orbitopathy, orbital inflammation, orbital lymphoma, lacrimal gland epithelial tumor, metastatic carcinoma, and vascular orbital lesions is ambiguous 7-10. Confirmation of the diagnosis frequently relies on a biopsy which can be technically challenging and prone to complications due to the dense arrangement of tissue or inaccessibility of many of these lesions 11. Visualization of orbital lesions is still based on pre-surgery image assessment of two-dimensional (2D) data visualization on a computer monitor or on intraoperative exploration 12,13. There are increasing possibilities for presentation and interaction with virtual reality 14. In this context, virtual reality (VR) has recently been optimized as an enhanced medical image display method and showed to safeguard visual comfort 15,16. The main objective of this study was to extend current medical image display and validate the level of spatial precision in orbitometry of CT data, representing the physical world, compared to precision in three-dimensional (3D) virtual reality for the first time. This is especially important when new ways are explored to use ...

show abstract

Section: Discussionmentioning

confidence: 99%

Validation of virtual reality orbitometry bridges digital and physical worlds

Maloca

Faludi

Żelechowski

et al. 2020

Sci Rep

View full text Add to dashboard Cite

show abstract

“…However, viewing a 3D image on a 2D flat panel display, such as a computer screen, lacks depth perception and limits the accuracy of quantitative 3D image analysis (Wheeler et al, 2018;Bassel, 2015). Virtual and augmented realities are emerging as innovative technologies for visualising computationally intense digital data.…”

Section: Accepted Manuscriptmentioning

confidence: 99%

Potential applications for virtual and augmented reality technologies in sensory science

Crofton

Botineștean

Fenelon

et al. 2019

Innovative Food Science & Emerging Technologies

View full text Add to dashboard Cite

Sensory science has advanced significantly in the past decade and is quickly evolving to become a key tool for predicting food product success in the marketplace. Increasingly, sensory data techniques are moving towards more dynamic aspects of sensory perception, taking account of the various stages of user-product interactions. Recent technological advancements in virtual reality and augmented reality have unlocked the potential for new immersive and interactive systems which could be applied as powerful tools for capturing and deciphering the complexities of human sensory perception. This paper reviews recent advancements in virtual and augmented reality technologies and identifies and explores their potential application within the field of sensory science. The paper also considers the possible benefits for the food industry as well as key challenges posed for widespread adoption. The findings indicate that these technologies have the potential to alter the research landscape in sensory science by facilitating promising innovations in five principal areas: consumption context, biometrics, food structure and texture, sensory marketing and augmenting sensory perception. Although the advent of augmented and virtual reality in sensory science offers new exciting developments, the exploitation of these technologies is in its infancy and future research will understand how they can be fully integrated with food and human responses. Industrial relevance The need for sensory evaluation within the food industry is becoming increasingly complex as companies continuously compete for consumer product acceptance in today's highly innovative and global food environment. Recent technological developments in virtual and augmented reality offer the food industry new opportunities for generating more reliable insights into consumer sensory perceptions of food and beverages, contributing to the design and development of new products with optimised consumer benefits. These technologies also hold significant potential for improving the predictive validity of newly launched products within the marketplace.

show abstract

“…Using VTK and ITK libraries [18][19][20][21][22], we have created computer vision algorithms for automatic segmentation of lungs, hearts, arteries and veins inside lung, tracheas and spines. This is a great advance respecting previous versions of this project [23,24].…”

Section: P O S Tmentioning

confidence: 99%

NextMed, Augmented and Virtual Reality platform for 3D medical imaging visualization

Izard

Plaza

Torres

et al. 2019

Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing Multiculturality

View full text Add to dashboard Cite

The visualization of the radiological results with more advanced techniques than the current ones, such as Augmented Reality and Virtual Reality technologies, represent a great advance for medical professionals, by eliminating their imagination capacity as an indispensable requirement for the understanding of medical images. The problem is that for its application it is necessary to segment the anatomical areas of interest, and this currently involves the intervention of the human being. The Nextmed project is presented as a complete solution that includes DICOM images import, automatic segmentation of certain anatomical structures, 3D mesh generation of the segmented area, visualization engine with Augmented Reality and Virtual Reality, all thanks to different software platforms that have been implemented and detailed, including results obtained from real patients. We will focus on the visualization platform using both Augmented and Virtual Reality technologies to allow medical professionals to work with 3d model representation of medical images in a different way taking advantage of new technologies.

show abstract

Virtual interaction and visualisation of 3D medical imaging data with VTK and Unity

Cited by 55 publications

References 10 publications

Validation of virtual reality orbitometry bridges digital and physical worlds

Validation of virtual reality orbitometry bridges digital and physical worlds

Potential applications for virtual and augmented reality technologies in sensory science

NextMed, Augmented and Virtual Reality platform for 3D medical imaging visualization

Contact Info

Product

Resources

About