Quality of Service Impact on Edge Physics Simulations for VR

Abstract

Mobile HMDs must sacrifice compute performance to achieve ergonomic and power requirements for extended use. Consequently, applications must either reduce rendering and simulation complexity -along with the richness of the experience -or offload complexity to a server. Within the context of edge-computing, a popular way to do this is through render streaming. Render streaming has been demonstrated for desktops and consoles. It has also been explored for HMDs. However, the latency requirements of head tracking make this application much more challenging. While mobile GPUs are not yet as capable as their desktop counterparts, we note that they are becoming more powerful and efficient. With the hard requirements of VR, it is worth continuing to investigate what schemes could optimally balance load, latency and quality. We propose an alternative we call edge-physics: streaming at the scene-graph level from a simulation running on edge-resources, analogous to cluster rendering. Scene streaming is not only straightforward, but compute and bandwidth efficient. The most demanding loops run locally. Jobs that hit the power-wall of mobile CPUs are off-loaded, while improving GPUs are leveraged, maximising compute utilisation. In this paper we create a prototypical implementation and evaluate its potential in terms of fidelity, bandwidth and performance. We show that an effective system which maintains high consistencies on typical edge-links can be easily built, but that some traditional concepts are not applicable, and a better understanding of the perception of motion is required to evaluate such a system comprehensively.

Immersive Display Design Based on Deep Learning Intelligent VR Technology

“…At present, these are basically generated by various sensors on the device, such as intelligent sensing ring, temperature sensor, photosensitive sensor, pressure sensor, and visual sensor, which can make the skin produce corresponding feelings through pulse current, or put tactile smell, and other senses are transmitted to the brain. The current immersive set developed by the Japanese research institute allows the device to give a percussive sensation appropriate to the force of the corresponding part when the player is tapped or hit [20]. Gravity, temperature, light, and pressure sensors are also available options that need to be integrated into the overall system.…”

Animation Art Design Online System Based on Mobile Edge Computing and User Perception

“…Mobile edge computing networks use the hardware resources on small base stations to assist users in handling such tasks [2]. The decision to perform task migration in this new computing model faces many new challenges such as complex task requirements, high user mobility, diverse applications and services, and limited computing and storage resources of small base stations [3]. Therefore, how to collect and use the new features of the mobile edge network and improve the task allocation decision and data transmission efficiency involved in the task migration process are all topics and directions that are worthy of in-depth study [4][5][6].…”