Overcoming latency with motion prediction in directional autostereoscopic displays

Zhang, Hantao; Chen, Mingjun; Li, Xiaoke; Li, Kunyang; Chen, Xuehao; Wang, Jiahui; Liang, Haowen; Zhou, Jianying; Liang, Weitang; Fan, Heng; Ding, Ruijie; Wang, Shuying; Deng, Dongyan

doi:10.1002/jsid.848

Cited by 8 publications

(4 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…With this technique, two front cameras were used to determine the exact location of the retina, and the test pictures or videos were sent to the subject's eyes to detect any possible movement, hence enhancing the accuracy of the examination. Furthermore, the eye-tracking technique can be used to instantaneously detect a subject's movement using state-of-the-art eye-tracking technique with motion prediction to produce a flicker-free viewing experience (30,31).…”

Section: Discussionmentioning

confidence: 99%

Rapid, accurate, multifunctional and self-assisted vision assessment and screening with interactive desktop autostereoscopy

Li¹,

Zhong²,

Wang³

et al. 2021

Ann Transl Med

Self Cite

View full text Add to dashboard Cite

Background: This study aimed to develop an interactive vision screening tool based on desktop autostereoscopy and evaluate its feasibility for testing visual acuity, colour vision, stereo vision and binocular balance clinically.Methods: An interactive desktop autostereoscopy vision test was developed making it remarkably convenient for individuals to undergo multiple visual function assessments in a single test. With this rapid screening process, an individual's visual acuity, colour vision, stereo vision and binocular balance can be assessed within several minutes. A total of 155 healthy subjects were enrolled to compare the clinical repeatability, accuracy, inter-visit variability, likeability and efficiency between the autostereoscopy and traditional method. Results: In the repeatability test, the visual acuity measured with autostereoscopy was 0.045±0.018 and 0.035±0.018 (P=0.702) for the first and second tests, respectively. The mean logarithm of the Minimum Angle of Resolution (logMAR) visual acuities measured with the Early Treatment Diabetic Retinopathy Study (EDTRS) chart and autostereoscopy test were 0.04±0.02 and 0.05±0.02, respectively, which were not significantly different (P=0.849). The correlation between these two kinds of tests was statistically significant (Spearman correlation coefficient =0.829, P<0.001). The results for colour vision, stereo vision, and binocular vision are presented, and the effectiveness of the autostereoscopic method is supported with qualitative data comparing its results with those of the traditional methods. In the likeability test, the EDTRS chart and autostereoscopy test had scores of 2.21±0.53 and 3.04±0.07, while the traditional and autostereoscopy tests for colour vision, stereo vision, and binocular vision had scores of 2.02±0.59 and 3.36±0.93, respectively (P<0.001). Regarding visual fatigue, the mean scores were 0.69±0.04 and 0.42±0.04 (P<0.001) with the EDTRS chart and autostereoscopy test, respectively. Regarding work efficiency, the average testing times per person was 59.65±0.66 and 48.92±0.86 s (P<0.001) with the EDTRS chart and autostereoscopy test, respectively. Conclusions:The autostereoscopy test was conclusively shown to be valid, efficient and repeatable for the measurement of visual acuity, colour vision, stereo vision, and binocular vision, and the process was subjectively well-liked and comfortable.

show abstract

Section: Discussionmentioning

confidence: 99%

Rapid, accurate, multifunctional and self-assisted vision assessment and screening with interactive desktop autostereoscopy

Li¹,

Zhong²,

Wang³

et al. 2021

Ann Transl Med

Self Cite

View full text Add to dashboard Cite

show abstract

“…Even though this study predicted 6DoF motion among VR users, the data collected from the sample did not explore the worst-case scenarios for when the user performs abrupt movements while playing VR games, focusing instead on scenery-based VR apps. Another limitation in this study was their use of 60 window time data (666 ms) to predict only 11 ms in the future, which is not practical since recent VR-HMDs still have latency between 43 and 85 ms [5][6][7][8][9].…”

Section: Related Studiesmentioning

confidence: 99%

“…These accumulated delays can be reduced but never eliminated since they come from the hardware and software requirements. Moreover, recent literature from 2019-2020 showed that current VR-HMD still possesses an MTP latency varying between 43 and 85 ms [5][6][7][8][9]. Using an Acer device, R. Gruen et al (2020) tested the latency on four different VR devices: Oculus Rift S, Valve Index, Oculus Quest, and Prim.…”

Section: Introductionmentioning

confidence: 99%

Surface EMG vs. High-Density EMG: Tradeoff Between Performance and Usability for Head Orientation Prediction in VR Application

et al. 2021

View full text Add to dashboard Cite

Head orientation prediction is one of the solutions to reduce end-to-end latency on Virtual Reality (VR) systems and is important since it can alleviate negative effects like motion sickness. This study compared head orientation prediction models from two different electromyography (EMG) systems: surface EMG (sEMG) and High-Density EMG (HD-EMG). The deep learning method was used to train the prediction model, and the results showed that the model with input from the pre-processed sEMG + IMU sensor outperformed the model with input from the HD-EMG + IMU sensor. However, the decreasing performance from HD-EMG was compensated by its comfort and the ease of use of its electrode. This tradeoff between performance and usability with sEMG compared to HD-EMG should be a consideration for users who want to choose between performance and ease of use for head orientation prediction purposes. Comparison with state-of-the-art head prediction methods proved that the sEMG-based model offers better performance in predictions when users change their head directions, which was quantified by calculating the dt peaks. In other words, our sEMG-based prediction model is suitable for VR applications, which require the user to perform high-intensity or abrupt movements, such as in FPS games or exercise/sports games. INDEX TERMS deep neural network, head orientation prediction, high-density electromyography, lowlatency virtual reality, surface electromyography.

show abstract

“…26 The crosstalk can cause visual fatigue and even physiological discomfort, which should be controlled to a lowest possible value. To reduce the temporal crosstalk, the screen and the backlight need refreshing synchronously, 26 or the gating time of the backlight in the DBAD system in a refresh cycle is adjusted to 2 ms. 27,28 Two-dimensional (2D) lens array and 2D backlight array may be helpful to control the crosstalk, but it is technically difficult to realize at present. 26 Moreover, the majority of 4, 8 even 16 K panels work in low refresh rate, which are not suitable for temporal shutter scheme.…”

Section: Introductionmentioning

confidence: 99%

A polarization modulated directional backlight autostereoscopic display

Fan

Chen

et al. 2022

J Soc Info Display

Self Cite

View full text Add to dashboard Cite

A polarization modulated directional backlight autostereoscopic display is proposed and demonstrated. The system consists of the orthogonally polarized backlight, the Fresnel lens array, a light shaping diffuser film, and a liquid crystal display (LCD) with a microphase retardation film. The autostereoscopic image pair carried by the directional light with different polarization directions is simultaneously projected to different spatial directions. The simulation and experimental results show that the directional projection of parallax images is realized for a high‐quality autostereoscopic display with large viewing angle and continuous viewing volume, hence making it suitable for practical applications.

show abstract

Overcoming latency with motion prediction in directional autostereoscopic displays

Cited by 8 publications

References 25 publications

Rapid, accurate, multifunctional and self-assisted vision assessment and screening with interactive desktop autostereoscopy

Rapid, accurate, multifunctional and self-assisted vision assessment and screening with interactive desktop autostereoscopy

Surface EMG vs. High-Density EMG: Tradeoff Between Performance and Usability for Head Orientation Prediction in VR Application

A polarization modulated directional backlight autostereoscopic display

Contact Info

Product

Resources

About