Marker-Based Localization of the Microsoft Hololens in Building Models

Hübner, Patrick; Weinmann, Martin; Wursthorn, Sven

doi:10.5194/isprs-archives-xlii-1-195-2018

Cited by 23 publications

(11 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While different studies testing the accuracy of ArUco marker-based registration can be found in the literature [24,29], the units of accuracy are not usually given in mm, but rather in pixels and computing time because the camera used in the MR device has a major role in its registration accuracy. There are, however, some ArUco-based MR registration studies using the HoloLens that give accuracy in ranges from 0.47 mm to 2.3 cm [30,31]. Our results fall in this range.…”

Section: Discussioncontrasting

confidence: 45%

Value of the surgeon’s sightline on hologram registration and targeting in mixed reality

et al. 2020

View full text Add to dashboard Cite

Purpose Mixed reality (MR) is being evaluated as a visual tool for surgical navigation. Current literature presents unclear results on intraoperative accuracy using the Microsoft HoloLens 1®. This study aims to assess the impact of the surgeon’s sightline in an inside-out marker-based MR navigation system for open surgery. Methods Surgeons at Akershus University Hospital tested this system. A custom-made phantom was used, containing 18 wire target crosses within its inner walls. A CT scan was obtained in order to segment all wire targets into a single 3D-model (hologram). An in-house software application (CTrue), developed for the Microsoft HoloLens 1, uploaded 3D-models and automatically registered the 3D-model with the phantom. Based on the surgeon’s sightline while registering and targeting (free sightline /F/or a strictly perpendicular sightline /P/), 4 scenarios were developed (FF-PF-FP-PP). Target error distance (TED) was obtained in three different working axes-(XYZ). Results Six surgeons (5 males, age 29–62) were enrolled. A total of 864 measurements were collected in 4 scenarios, twice. Scenario PP showed the smallest TED in XYZ-axes mean = 2.98 mm ± SD 1.33; 2.28 mm ± SD 1.45; 2.78 mm ± SD 1.91, respectively. Scenario FF showed the largest TED in XYZ-axes with mean = 10.03 mm ± SD 3.19; 6.36 mm ± SD 3.36; 16.11 mm ± SD 8.91, respectively. Multiple comparison tests, grouped in scenarios and axes, showed that the majority of scenario comparisons had significantly different TED values (p < 0.05). Y-axis always presented the smallest TED regardless of scenario tested. Conclusion A strictly perpendicular working sightline in relation to the 3D-model achieves the best accuracy results. Shortcomings in this technology, as an intraoperative visual cue, can be overcome by sightline correction. Incidentally, this is the preferred working angle for open surgery.

show abstract

Section: Discussioncontrasting

confidence: 45%

Value of the surgeon’s sightline on hologram registration and targeting in mixed reality

et al. 2020

View full text Add to dashboard Cite

show abstract

“…The video frames can be analyzed to measure distances between holograms and their targets. While this approach is objective, multiple groups have noted that holograms can appear misaligned in mixed reality captures even when users perceived accurate alignment [43] , [57] . These studies concluded that mixed reality captures are unreliable for quantifying error.…”

Section: Registration Accuracymentioning

confidence: 99%

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

Andrews

Henry²,

Soriano³

et al. 2021

IEEE J. Transl. Eng. Health Med.

View full text Add to dashboard Cite

Many clinical procedures would benefit from direct and intuitive real-time visualization of anatomy, surgical plans, or other information crucial to the procedure. Three-dimensional augmented reality (3D-AR) is an emerging technology that has the potential to assist physicians with spatial reasoning during clinical interventions. The most intriguing applications of 3D-AR involve visualizations of anatomy or surgical plans that appear directly on the patient. However, commercially available 3D-AR devices have spatial localization errors that are too large for many clinical procedures. For this reason, a variety of approaches for improving 3D-AR registration accuracy have been explored. The focus of this review is on the methods, accuracy, and clinical applications of registering 3D-AR devices with the clinical environment. The works cited represent a variety of approaches for registering holograms to patients, including manual registration, computer vision-based registration, and registrations that incorporate external tracking systems. Evaluations of user accuracy when performing clinically relevant tasks suggest that accuracies of approximately 2 mm are feasible. 3D-AR device limitations due to the vergenceaccommodation conflict or other factors attributable to the headset hardware add on the order of 1.5 mm of error compared to conventional guidance. Continued improvements to 3D-AR hardware will decrease these sources of error.

show abstract

“…Hübner et al [21] processed the augmentation and placement of the indoor environment into virtual indoor model data in an AR device (HoloLens) using marker-based localization. After determining the pose of the AR device for the coordinate system of the real physical world, building information modeling data were overlaid.…”

Section: Marker-based Indoor Localizationmentioning

confidence: 99%

A Hybrid Marker-Based Indoor Positioning System for Pedestrian Tracking in Subway Stations

Lee

Kim

2020

Applied Sciences

View full text Add to dashboard Cite

The use of smartphones for accurate navigation in underground spaces, such as subway stations, poses several challenges. This is because it is difficult to obtain a sure estimate of user location due to the radio signal interference caused by the entry and exit of trains, the infrastructure of the subway station installation, and changes in the internal facility environment. This study uses quick response markers and augmented reality to solve these difficulties using an error correction method. Specifically, a hybrid marker-based indoor positioning system (HMIPS) which provides accurate and efficient user-tracking results is proposed. The HMIPS performs hybrid localization by using marker images as well as inertial measurement unit data from smartphones. It utilizes the Viterbi tracking algorithm to solve the problem of tracking accuracy degradation that may occur when inertial sensors are used by adopting a sensor error correction technique. In addition, as an integrated system, the HMIPS provides a tool to easily carry out all the steps necessary for positioning. The results of experiments conducted in a subway station environment confirm that the HMIPS provides accurate and practical navigation services. The proposed system is expected to be useful for indoor navigation, even in poor indoor positioning environments.

show abstract

Marker-Based Localization of the Microsoft Hololens in Building Models

Cited by 23 publications

References 21 publications

Value of the surgeon’s sightline on hologram registration and targeting in mixed reality

Value of the surgeon’s sightline on hologram registration and targeting in mixed reality

Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices

A Hybrid Marker-Based Indoor Positioning System for Pedestrian Tracking in Subway Stations

Contact Info

Product

Resources

About