Applying Modern Virtual and Augmented Reality Technologies to Medical Images and Models

Abstract

Recent technological innovations have created new opportunities for the increased adoption of virtual reality (VR) and augmented reality (AR) applications in medicine. While medical applications of VR have historically seen greater adoption from patient-as-user applications, the new era of VR/AR technology has created the conditions for wider adoption of clinician-as-user applications. Historically, adoption to clinical use has been limited in part by the ability of the technology to achieve a sufficient quality of experience. This article reviews the definitions of virtual and augmented reality and briefly covers the history of their development. Currently available options for consumer-level virtual and augmented reality systems are presented, along with a discussion of technical considerations for their adoption in the clinical environment. Finally, a brief review of the literature of medical VR/AR applications is presented prior to introducing a comprehensive conceptual framework for the viewing and manipulation of medical images in virtual and augmented reality. Using this framework, we outline considerations for placing these methods directly into a radiology-based workflow and show how it can be applied to a variety of clinical scenarios.

Recent Trends and Future Direction of Dental Research in the Digital Era

“…In most cases, it is the superimposition of additional digital information on live images or videos. VR, in contrast, uses only artificial computerized scenarios without connection to reality [14]. Depending on the technique, every conceivable way of sensation can be used, mainly visual, auditory, and haptic, independently or in any combination [15].…”

Technology Considerations in Health Professions and Clinical Education

“…Augmented reality allows the opportunity to provide 3D interactive resources outside the classroom, such as that utilised in paramedic distance education (Birt et al, 2017) or enhance anatomy learning content (Moro et al, 2017a). It can also assist in training teachers (Sural, 2018), create clinical scenarios (Sutherland et al, 2019), or enhance training for specific health professions such as radiation oncology (Jin et al, 2017). One benefit of augmented reality is the ability for consumer-level smartphones or tablets to render models in 3D.…”

Virtual and augmented reality for preoperative planning in plastic surgical procedures: A systematic review

“…Virtual reality (VR) facilitates the visualization of digital information in three dimensions 1 . VR is a simulated experience, often consisting of realistically generated images and sounds 1 . The concept of VR was introduced in the 1950s, while early prototypes similar to modern technology emerged in the 1980s 1 , 2 .…”

“…The concept of VR was introduced in the 1950s, while early prototypes similar to modern technology emerged in the 1980s 1 , 2 . The simulation is usually created through the use of a head-mounted display with a small screen in front of the eyes 1 . Stereoscopic glasses inside the headset create a 3D world where the user can look and move around 1 .…”