An application of the virtual prototyping approach to design of VR, AR, and MR devices free from the vergence-accommodation conflict

Optoelectronic Imaging and Multimedia Technology IX

Esedov

et al. 2023

There are two main types of mixed reality systems, these are optical see-through mixed and video see-through devices. The main difference between them is how the user observes the real-world. In the case of the optical see-through mixed reality system, the device user observes the real-world directly, and in the case of the video see-through mixed reality system, they observe the real world projected from the LCD screens to the eye retina. As a result, in the first case, the vergence of human eyes corresponds to the point where sight is directed, however in the case of the video see-through system it is not true as the direction of human sight might not correspond to the fixed direction of device cameras. Moreover, these cameras might be shifted to the top or bottom of a mixed reality device or replaced with a single RGBD camera which might result in additional discomfort. So, when observing the real-world using the video see-through mixed reality system an additional image processing is required to lower the disagreement of the vergence between device cameras and user's eyes according to the data acquired from the device eye-tracking system. In the scope of the current research, authors present the results of research of lowering the vergence disagreement based on the rough depth map restoration and processing images from device cameras as a cloud of points. Various external camera setups and corresponding vergence correction results are compared.

Section: Vergence Reconstructionmentioning

confidence: 99%

Adaptive vergence reconstruction method for mixed reality systems

Optoelectronic Imaging and Multimedia Technology IX

Esedov

et al. 2023

“…Examining how virtual or augmented reality technologies affect how people experience them in the real and virtual worlds. The comfort of visual perception is a focus of research in virtual and augmented reality systems, which include both personal wearable gadgets and systems of head-mounted displays or head-up displays on a windshield 1 …”

Section: Introductionmentioning

confidence: 99%

Virtual prototyping of complex optical systems on multiprocessor workstations

Sorokin

et al. 2022

Opt. Eng.

Self Cite

Nowadays, optical designers often use multiprocessor workstations for the virtual prototyping of complex optical systems. Modern workstations may have several CPUs with up to 128 virtual cores each and a non-uniform access speed to different memory areas. Effective implementation of virtual prototyping methods and algorithms requires the development of special methods for efficient algorithm parallelization and shared memory access. As a basis for the virtual prototyping, we proposed a progressive backward photon mapping method that allows for reducing the amount of data used by photon maps, speeding up the luminance calculation process, and estimating the luminance errors for the resulting image. The main algorithmic complexity of this method is the need to synchronize data when calculating and accumulating the luminance of indirect and caustic illumination. The authors propose the three-level semi-synchronous parallelization method, which consists of fully synchronous, semi-synchronous, and asynchronous levels with illumination processing effectively distributed among the computation threads. The main benefit of the developed method is that it does not require additional synchronization when accumulating luminance, thus increasing the image synthesis speed. The designed three-level method can also be used in distributed systems with good scalability. The results obtained with virtual prototypes of complex optical systems are presented.

“…A good example of such a device is the three-hologram system of a HoloLens mixedreality device [13]. Another example of the use of hologram optical elements can be dynamic phase modulators used in virtual reality systems to eliminate the discomfort of visual perception caused by the mismatch of vergence and accommodation of human vision that occurs when observing a flat image on a CCD matrix [14][15][16].…”

Section: Introductionmentioning

confidence: 99%

Methods for the synthesis of realistic images formed by optical devices containing hologram optical elements

Potemin

CPT2020 the 8th International Scientific Conference on Computing in Physics and Technology Proceedings

et al. 2020

Self Cite

Nowadays, virtual tests of optical systems with holographic elements are being used more and more. Despite the fact that holographic optical elements have existed for decades and most programs for designing optical systems include ray tracing modules in optical systems containing holographic elements, the synthesis of realistic images formed by these systems is absent in most of these programs. The paper presents the results of a study of the possibility of implementing an effective and physically accurate stochastic ray tracing through hologram optical elements. The theoretical foundations of the light propagation through hologram optical elements are considered and a detailed ray tracing algorithm for its implementation in forward, backward and bidirectional stochastic ray tracing methods are presented. The results of modeling the propagation of rays and the synthesis of a realistic image formed by a two-hologram augmented reality system are presented. Also, we conducted a study of the influence of the observer's eye pupil position on the quality of the formed image.