Perception of perspective in augmented reality head-up displays

Bremers, Alexandra W.D.; Yöntem, Ali Özgür; Li, Kun; Chu, Daping; Meijering, Valerian; Janssen, Christian P.

doi:10.1016/j.ijhcs.2021.102693

Cited by 17 publications

(6 citation statements)

References 49 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…AR HMDs are divided into optical see-through devices and video see-through devices [ 11 , 12 , 13 , 15 , 16 , 17 , 23 , 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 ]. In this study, the authors used the HoloLens 2, an optical see-through HMD.…”

Section: Discussionmentioning

confidence: 99%

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Ruggiero

Cercenelli

Emiliani

et al. 2023

JCM

View full text Add to dashboard Cite

Background: Augmented reality (AR) allows the overlapping and integration of virtual information with the real environment. The camera of the AR device reads the object and integrates the virtual data. It has been widely applied to medical and surgical sciences in recent years and has the potential to enhance intraoperative navigation. Materials and methods: In this study, the authors aim to assess the accuracy of AR guidance when using the commercial HoloLens 2 head-mounted display (HMD) in pediatric craniofacial surgery. The Authors selected fronto-orbital remodeling (FOR) as the procedure to test (specifically, frontal osteotomy and nasal osteotomy were considered). Six people (three surgeons and three engineers) were recruited to perform the osteotomies on a 3D printed stereolithographic model under the guidance of AR. By means of calibrated CAD/CAM cutting guides with different grooves, the authors measured the accuracy of the osteotomies that were performed. We tested accuracy levels of ±1.5 mm, ±1 mm, and ±0.5 mm. Results: With the HoloLens 2, the majority of the individuals involved were able to successfully trace the trajectories of the frontal and nasal osteotomies with an accuracy level of ±1.5 mm. Additionally, 80% were able to achieve an accuracy level of ±1 mm when performing a nasal osteotomy, and 52% were able to achieve an accuracy level of ±1 mm when performing a frontal osteotomy, while 61% were able to achieve an accuracy level of ±0.5 mm when performing a nasal osteotomy, and 33% were able to achieve an accuracy level of ±0.5 mm when performing a frontal osteotomy. Conclusions: despite this being an in vitro study, the authors reported encouraging results for the prospective use of AR on actual patients.

show abstract

Section: Discussionmentioning

confidence: 99%

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Ruggiero

Cercenelli

Emiliani

et al. 2023

JCM

View full text Add to dashboard Cite

show abstract

“…AR is a promising technology for craniofacial surgeons to obtain a “see-through” effect in the operating room. However, some problems with AR, such as depth perception ( 27 ) and registration errors ( 28 ), i.e. the difference between virtual content and actual reality resulting in bias for users, still remain.…”

Section: Discussionmentioning

confidence: 99%

Augmented Reality to Assist Skin Paddle Harvesting in Osteomyocutaneous Fibular Flap Reconstructive Surgery: A Pilot Evaluation on a 3D-Printed Leg Phantom

et al. 2022

View full text Add to dashboard Cite

BackgroundAugmented Reality (AR) represents an evolution of navigation-assisted surgery, providing surgeons with a virtual aid contextually merged with the real surgical field. We recently reported a case series of AR-assisted fibular flap harvesting for mandibular reconstruction. However, the registration accuracy between the real and the virtual content needs to be systematically evaluated before widely promoting this tool in clinical practice. In this paper, after description of the AR based protocol implemented for both tablet and HoloLens 2 smart glasses, we evaluated in a first test session the achievable registration accuracy with the two display solutions, and in a second test session the success rate in executing the AR-guided skin paddle incision task on a 3D printed leg phantom.MethodsFrom a real computed tomography dataset, 3D virtual models of a human leg, including fibula, arteries and skin with planned paddle profile for harvesting, were obtained. All virtual models were imported into Unity software to develop a marker-less AR application suitable to be used both via tablet and via HoloLens 2 headset. The registration accuracy for both solutions was verified on a 3D printed leg phantom obtained from the virtual models, by repeatedly applying the tracking function and computing pose deviations between the AR-projected virtual skin paddle profile and the real one transferred to the phantom via a CAD/CAM cutting guide. The success rate in completing the AR-guided task of skin paddle harvesting was evaluated using CAD/CAM templates positioned on the phantom model surface.ResultsOn average, the marker-less AR protocol showed comparable registration errors (ranging within 1-5 mm) for tablet-based and HoloLens-based solution. Registration accuracy seems to be quite sensitive to ambient light conditions. We found a good success rate in completing the AR-guided task within an error margin of 4 mm (97% and 100% for tablet and HoloLens, respectively). All subjects reported greater usability and ergonomics for HoloLens 2 solution.ConclusionsResults revealed that the proposed marker-less AR based protocol may guarantee a registration error within 1-5 mm for assisting skin paddle harvesting in the clinical setting. Optimal lightening conditions and further improvement of marker-less tracking technologies have the potential to increase the efficiency and precision of this AR-assisted reconstructive surgery.

show abstract

“…In the AR-HUD projection process, the projected image needs to be combined with the real scene. Considering driving comfort, the virtual visual distance of the AR-HUD required in the industry is between 7.5 m and 20 m [10]. This paper adopts the 7.5 m virtual visual distance commonly used in the industry as the design objective.…”

Section: Design Parameter Analysismentioning

confidence: 99%

Initial Structure Design and Optimization of an Automotive Remote Head-Up Display

Ye,

Chen,

Wang

2023

Applied Sciences

View full text Add to dashboard Cite

Aiming at the problems of difficult construction and occlusion of the initial structure of an automotive augmented reality head-up display (AR-HUD), a method to quickly build the initial structure of an automotive AR-HUD is proposed. Firstly, the position of the mirrors in the initial structure is calculated based on the Rodrigues rotation formula. Secondly, the position of the mirrors is restricted by constraints during optimization to prevent the problem of structural occlusion. Finally, a virtual image display system with a visual distance of 7.5 m and a field of view angle of 10° × 5° is designed. The image quality analysis of the optimized system shows that the light spots in each field of view are all within Airy spots. At the spatial cutoff frequency of the virtual image plane of the optical system, the modulation transfer function (MTF) value of the full field of view is basically greater than 0.5, and the distortion is less than 1%. Finally, using the image for simulation, the results of the simulation image are satisfying, which proves the validity and feasibility of the structural design. It provides a useful reference for the structural design of the remote head-up display system.

show abstract

Perception of perspective in augmented reality head-up displays

Cited by 17 publications

References 49 publications

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Augmented Reality to Assist Skin Paddle Harvesting in Osteomyocutaneous Fibular Flap Reconstructive Surgery: A Pilot Evaluation on a 3D-Printed Leg Phantom

Initial Structure Design and Optimization of an Automotive Remote Head-Up Display

Contact Info

Product

Resources

About