Effective Application of Mixed Reality Device HoloLens: Simple Manual Alignment of Surgical Field and Holograms

Mitsuno, Daisuke; Ueda, Kazuki; Hirota, Yuka; Ogino, Mariko

doi:10.1097/prs.0000000000005215

Cited by 63 publications

(31 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…8 Applications of this apparatus and other MR devices are being studied in areas such as education, engineering, medicine, manufacturing, and even cooking. [8][9][10][11]…”

Section: Virtual Realitymentioning

confidence: 99%

Immersive Extended Reality use in Medical Education with Implications for Remote and Space Medicine Training

Malik¹,

Sirek²

2022

UWOMJ

View full text Add to dashboard Cite

Objective: Medical education continually adapts and evolves as evidence-based practice expands our knowledge. Ease of access and reduced cost of novel technology has revolutionized delivery of medical education. Immersive extended reality (iXR) technology may play an invaluable role in improving delivery and quality of medical education in rural and extra-planetary settings. Methods: An extensive literature review was conducted for using MeSH terms specific to iXR technology related to medical education. Relevant manuscripts were accessed from database searches and filtered based on pre-specified inclusion and exclusion criteria. Extraction of data and thematic qualitative analysis was conducted in relation to relevance to remote medical training with an emphasis on potential for deep-space exploration class missions. Results: From a total of 4005 search results, 35 final papers met inclusion criteria for this study. Current applications of virtual, augmented and mixed reality technology in medical education were explored, and themes from each modality of iXR technology were defined. Conclusions: Themes determined from the results were applied to a discussion regarding the application of iXR technology in two distinct areas: remote and rural medical training and space medicine. Relative strengths and weaknesses of each modality of iXR were explored and applied to the unique factors impacting medical education delivery in these two domains.

show abstract

“…8 Applications of this apparatus and other MR devices are being studied in areas such as education, engineering, medicine, manufacturing, and even cooking. [8][9][10][11]…”

Section: Virtual Realitymentioning

confidence: 99%

Immersive Extended Reality use in Medical Education with Implications for Remote and Space Medicine Training

Malik¹,

Sirek²

2022

UWOMJ

View full text Add to dashboard Cite

show abstract

“…A downside to manual registrations is that they can be tedious and difficult to perform accurately. One group developed a novel software interface to simplify the registration process for the user [27]. The method uses three fiducial points and allows the user to perform the registration in three steps, where two of the steps only require simple rotations.…”

Section: Manual Registrationsmentioning

confidence: 99%

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

Andrews

Henry²,

Soriano³

et al. 2021

IEEE J. Transl. Eng. Health Med.

View full text Add to dashboard Cite

Many clinical procedures would benefit from direct and intuitive real-time visualization of anatomy, surgical plans, or other information crucial to the procedure. Three-dimensional augmented reality (3D-AR) is an emerging technology that has the potential to assist physicians with spatial reasoning during clinical interventions. The most intriguing applications of 3D-AR involve visualizations of anatomy or surgical plans that appear directly on the patient. However, commercially available 3D-AR devices have spatial localization errors that are too large for many clinical procedures. For this reason, a variety of approaches for improving 3D-AR registration accuracy have been explored. The focus of this review is on the methods, accuracy, and clinical applications of registering 3D-AR devices with the clinical environment. The works cited represent a variety of approaches for registering holograms to patients, including manual registration, computer vision-based registration, and registrations that incorporate external tracking systems. Evaluations of user accuracy when performing clinically relevant tasks suggest that accuracies of approximately 2 mm are feasible. 3D-AR device limitations due to the vergenceaccommodation conflict or other factors attributable to the headset hardware add on the order of 1.5 mm of error compared to conventional guidance. Continued improvements to 3D-AR hardware will decrease these sources of error.

show abstract

“…Many prototypes of applications based on the Microsoft HoloLens employ either a) manual registration by the user [3] or b) marker tracking [4][5][6]. Option a) offers the advantage of being easy to implement, and can produce accurate registration.…”

Section: Related Workmentioning

confidence: 99%

Accuracy of Marker Tracking on an Optical See-Through Head Mounted Display

Brand

Wulff

Hamdani

et al. 2020

Annals of Scientific Society for Assembly, Handling and Industrial Robotics

View full text Add to dashboard Cite

This work assesses the accuracy of mono and stereo vision-based marker tracking on the Microsoft HoloLens as a representative of current generation AR devices. This is motivated by the need to employ object tracking in industrial AR applications. We integrate mono and stereo vision-based marker tracking with the HoloLens. A calibration procedure is developed that allows users to assess the accuracy of the calibration alignments by walking around the virtual calibration target. This can be generally applied when calibrating additional tracking systems with ready-made AR systems. Finally, the accuracy that can be achieved with the developed system is evaluated (comparing the influence of different parameters).

show abstract

Effective Application of Mixed Reality Device HoloLens: Simple Manual Alignment of Surgical Field and Holograms

Cited by 63 publications

References 20 publications

Immersive Extended Reality use in Medical Education with Implications for Remote and Space Medicine Training

Immersive Extended Reality use in Medical Education with Implications for Remote and Space Medicine Training

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

Accuracy of Marker Tracking on an Optical See-Through Head Mounted Display

Contact Info

Product

Resources

About