When virtual and real worlds coexist: Visualization and visual system affect spatial performance in augmented reality

Abstract

New visualization approaches are being actively developed aiming to mitigate the effect of vergence-accommodation conflict in stereoscopic augmented reality; however, high interindividual variability in spatial performance makes it difficult to predict user gain. To address this issue, we investigated the effects of consistent and inconsistent binocular and focus cues on perceptual matching in the stereoscopic environment of augmented reality using a head-mounted display that was driven in multifocal and single focal plane modes. Participants matched the distance of a real object with images projected at three viewing distances, concordant with the display focal planes when driven in the multifocal mode. As a result, consistency of depth cues facilitated faster perceptual judgments on spatial relations. Moreover, the individuals with mild binocular and accommodative disorders benefited from the visualization of information on the focal planes corresponding to image planes more than individuals with normal vision, which was reflected in performance accuracy. Because symptoms and complaints may be absent when the functionality of the sensorimotor system is reduced, the results indicate the need for a detailed assessment of visual functions in research on spatial performance. This study highlights that the development of a visualization system that reduces visual stress and improves user performance should be a priority for the successful implementation of augmented reality displays.

Prevalence of oculomotor changes following the near work in stereoscopic augmented reality

“…Considering the work of the visual system when viewing stereoscopic images via augmented reality headsets, most attention was previously devoted to investigating perceptual issues such as focus rivalry 12 and misjudgment of spatial relationships 1,13,14,15 . We revealed a decline of vergence and accommodation ability in about 40% of the group after the near work in stereoscopic augmented reality.…”

“…To ensure that individuals will be able to use augmented and virtual reality technologies, there is a need to study human factors and develop technologies that will meet individual needs. As the user experience and performance rely on the adequate work of the human visual system 1,2 , special attention should be given to the possible changes in visual parameters associated with the use of near-eye displays.…”

Comparison of the Observation Errors of Augmented and Spatial Reality Systems

“…However, the measured values did not show any correlations between the distinctness and the three dimensions. Problems with convergence distance and focal length have been reported when using HMDs [19], and HMDs at distances closer than 1.0 m can cause visual strain. The positional relationship between the eye, the AR monitor, and the object at a close range has also been reported to cause convergence and adjustment conflicts [20].…”

Inclusivity in stereoscopic XR: Human vision first

“…Many do not experience symptoms in the natural world (Atiya et al, 2020), because situations that cause discomfort can be avoided. However, it is important to note that anyone who has difficulties in maintaining binocular fusion in the natural world is further disadvantaged in a stereoscopic XR world because of the vergence-accommodation conflict (Pladere et al, 2021). For some people, the feeling of discomfort that emerges after a few minutes of using XR HMDs will discourage them from using XR technologies further.…”