Integrating Both Parallax and Latency Compensation into Video See-through Head-mounted Display

Ishihara, Atsushi; Aga, Hiroyuki; Ishihara, Yuki; Ichikawa, Hirotake; Kaji, Hidetaka; Kobayashi, Daita; Kobayashi, Toshimi; Nishida, Ken; Hamasaki, Takumi; Mori, Hideto; Kawasaki, Koichi; Morikubo, Yuki

doi:10.1109/tvcg.2023.3247460

Cited by 4 publications

(7 citation statements)

References 65 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Geometric distortion on two VST HMDs (the Meta Quest 3 and HTC VIVE XR Elite) was evaluated. Both the Quest 3 and VIVE XR Elite HMDs consist of binocular liquid crystal displays (LCDs) (Quest 3: 2064 × 2208 pixels; VIVE XR Elite: 1920 × 1920 pixels) with pancake lenses 4 . To pass‐through the physical surroundings, the Quest 3 implements a dual‐camera setup (one for each eye) with a displacement of 63 mm between the two cameras as illustrated in Figure 2A.…”

Section: Vst Hmdsmentioning

confidence: 99%

“…Both the Quest 3 and VIVE XR Elite HMDs consist of binocular liquid crystal displays (LCDs) (Quest 3: 2064 Â 2208 pixels; VIVE XR Elite: 1920 Â 1920 pixels) with pancake lenses. 4 To pass-through the physical surroundings, the Quest 3 implements a dual-camera setup (one for each eye) with a displacement of 63 mm between the two cameras as illustrated in Figure 2A. The recently released Apple Vision Pro HMD (not evaluated in this work) also implements the dual-camera setup.…”

Section: Vst Hmdsmentioning

confidence: 99%

“…However, in practice, this requirement is generally violated due to the bulky HMD hardware and challenge to accommodate various interpupillary distance (IPD) among users. Misalignment between the VST camera and user's eye position (both in‐plane and in‐depth) can result in substantial geometric distortion of the physical world, among other image artifacts such as parallax and disocclusion on VST HMDs 4,6 . Geometric distortion, in combination with latency 7 and lack of depth cue, 8 can contribute to visual discomfort and cybersickness 4 .…”

Section: Introductionmentioning

confidence: 99%

“…Misalignment between the VST camera and user's eye position (both in‐plane and in‐depth) can result in substantial geometric distortion of the physical world, among other image artifacts such as parallax and disocclusion on VST HMDs 4,6 . Geometric distortion, in combination with latency 7 and lack of depth cue, 8 can contribute to visual discomfort and cybersickness 4 . In addition to degrading the visual experience, geometric distortion of the physical space may potentially raise safety and effectiveness concerns, when using VST HMDs in medical applications, such as surgical procedures 9 …”

Section: Introductionmentioning

confidence: 99%

“…1 OST head-mounted displays (HMDs) pass the physical world through semitransparent displays and overlay digital content using optical combiners such as waveguides. 2,3 On the other hand, VST HMDs digitize and pass through the real-time physical surroundings using outward-facing cameras to augment the immersive visual experience 4 along with recent advancement in display optics. 5 To synthesize a realistic VST visualization, 3D geometric information of the physical world needs to be acquired by multiple space-tracking cameras and depth sensors.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Geometric distortion on video see‐through head‐mounted displays

Zhao,

Beams

2024

J Soc Info Display

View full text Add to dashboard Cite

Video see‐through (VST) head‐mounted displays (HMDs) reconstruct the physical world using outward‐facing cameras and depth sensors. One of the major challenges for VST HMDs is the geometric distortion of the physical pass‐through content. In this study, we present the experimental setup and metrology for VST geometric distortion measurement on single‐camera and dual‐camera VST HMDs. The VST geometric distortion is compared to the digital distortion by the HMD. Finally, we investigate the impacts of camera misalignment and depth distance on VST geometric distortion without and with angular‐based distortion correction. The results demonstrate that camera misalignment with respect to the eye position is the primary root cause for the distortion. Dual‐camera setup is necessary to minimize the VST geometric distortion by placing the cameras close to the eye positions. Although distortion correction can partially mitigate VST geometric distortion in a 2D plane, it remains a challenge for VST distortion correction at multiple depth distance in the 3D space. The method and findings presented of this study may provide guidelines for evaluation of spatial accuracy on VST HMDs and hardware design.

show abstract

Section: Vst Hmdsmentioning

confidence: 99%

Section: Vst Hmdsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Geometric distortion on video see‐through head‐mounted displays

Zhao,

Beams

2024

J Soc Info Display

View full text Add to dashboard Cite

show abstract

82‐1: Distinguished Paper: Geometric Distortion on Video See‐Through Head‐Mounted Displays

Zhao,

Beams

2024

Symp Digest of Tech Papers

View full text Add to dashboard Cite

We evaluate the geometric distortion on video see‐through (VST) head‐mounted displays (HMDs) with single‐camera and dualcamera design. We present the experimental setup and metrology for geometric calibration and VST geometric distortion measurement. Physical geometric distortion is compared to the distortion of digital content on a VST HMD. We investigate the impacts of camera misalignment and depth distance on VST geometric distortion with angular‐based distortion correction.

show abstract