Synchronous Remote Rendering for VR

Abstract

Remote rendering for VR is a technology that enables high-quality VR on low-powered devices. This is realized by offloading heavy computation and rendering to high-powered servers that stream VR as video to the clients. This article focuses on one specific issue in remote rendering when imperfect frame timing between client and server may cause recurring frame drops. We propose a system design that executes synchronously and eliminates the aforementioned problem. The design is presented, and an implementation is tested using various networks and hardware. The design cannot drop frames due to synchronization issues but may on the other hand stall if temporal disturbances occur, e.g., due to network delay spikes or loss. However, experiments confirm that such events can remain rare given an appropriate environment. For example, remote rendering on an intranet at 90 fps with a server located approximately 50 km away yielded just 0.002% stalled frames while rendering with extra latency corresponding to the duration of exactly one frame (11.1 ms at 90 fps). In a LAN without extra latency setting, i.e., with latency equal to locally rendered VR, 0.009% stalls were observed while using a wired Ethernet connection and 0.058% stalls when using 5 GHz wireless IEEE 802.11 ac.

Co-creation environment with cloud virtual reality and real-time artificial intelligence toward the design of molecular robots

“…In contrast to some game streaming services, such as GeForce Now or Google Stadia, and other visualization works [ 52 , 53 ], we chose to use local rendering for several reasons. First, the purpose of remote rendering is to offload computationally intense work from the client; however, our rendering is lightweight because it has been built from scratch for our use.…”

“…The shared dynamic VR objects can be handled through the conventional wide area network or the Internet. This is one of the major differences between our approach and the game streaming or remote rendering approaches [ 52 , 53 , 55 ], which would require a high-performance network such as a wired LAN or local 5G network if they were to deal with high-resolution VR images with millions of moving particles.…”

Multiform Art Design Strategy of VR Technology Based on Visual Design Perspective

“…VR technology is used to simulate the user's environment as a way of creating a virtual space that visualizes the interaction between the external environment and the user, which allows the user to explore and experience the environment more quickly and intuitively [2][3]. It is a product of the development of the network, the use of computer graphics systems, and control devices to automatically generate an interactive three-bit environment on the computer [4]. The rapid development of the network and the level of science and technology has made VR technology into interior design, road design, urban planning, monument restoration, tourism teaching classrooms, and other multifaceted areas, and has gradually developed into one of the three major technologies of modern society [5][6].…”

Hand-Controller Latency and Aiming Accuracy in 6-DOF VR

“…Typically, there is some game engine or physical actuator that is controlled remotely by the delayed input signals. Tat delay depends mainly on the network and codec [32], and it may be subject to physical constraints that cannot be solved without moving the actuation to the client. Moving the actuator may not be possible for physical applications but it could be done for some types of software by moving the afected logic to the client.…”