Cloud Gaming with Foveated Video Encoding

Illahi, Gazi; Gemert, Thomas van; Siekkinen, Matti; Masala, Enrico; Oulasvirta, Antti; Ylä-Jääski, Antti

doi:10.1145/3369110

Cited by 52 publications

(24 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The resolution of a tile delivered to the streaming client is proportional to its spatial proximity to the gaze location reported by the client. Illahi et al [243] design a foveated video streaming solution for cloud gaming, wherein a consumer-grade eye tracker at the gaming client is used to report the players' gaze to a cloud gaming server deployed in the edge-C3. The cloud gaming server is configured to encode the gameplay video with a quality dependent on the gaze location.…”

Section: Context-aware Video Edge Deliverymentioning

confidence: 99%

Video Caching, Analytics, and Delivery at the Wireless Edge: A Survey and Future Directions

Jedari

Premsankar

Illahi

et al. 2021

IEEE Commun. Surv. Tutorials

View full text Add to dashboard Cite

Section: Context-aware Video Edge Deliverymentioning

confidence: 99%

Video Caching, Analytics, and Delivery at the Wireless Edge: A Survey and Future Directions

Jedari

Premsankar

Illahi

et al. 2021

IEEE Commun. Surv. Tutorials

View full text Add to dashboard Cite

“…A work on foveated video encoding for cloud gaming on mobile phones present a maximum bitrate of 10Mbps that results in a Mean Opinion Score (MOS) of 69 on a scale of 0-100 [6]. 1920×1080@50 is reported as the used resolution.…”

Section: Cloud Gamingmentioning

confidence: 99%

Bitrate Requirements of Non-Panoramic VR Remote Rendering

Kelkkanen

Fiedler

Lindero

2020

Proceedings of the 28th ACM International Conference on Multimedia

View full text Add to dashboard Cite

This paper shows the impact of bitrate settings on objective quality measures when streaming non-panoramic remote-rendered Virtual Reality (VR) images. Non-panoramic here refers to the images that are rendered and sent across the network, they only cover the viewport of each eye, respectively. To determine the required bitrate of remote rendering for VR, we use a server that renders a 3D-scene, encodes the resulting images using the NVENC H.264 codec and transmits them to the client across a network. The client decodes the images and displays them in the VR headset. Objective full-reference quality measures are taken by comparing the image before encoding on the server to the same image after it has been decoded on the client. By altering the average bitrate setting of the encoder, we obtain objective quality scores as functions of bitrates. Furthermore, we study the impact of headset rotation speeds, since this will also have a large effect on image quality. We determine an upper and lower bitrate limit based on headset rotation speeds. The lower limit is based on a speed close to the average human peak head-movement speed, 360°/s. The upper limit is based on maximal peaks of 1080°/s. Depending on the expected rotation speeds of the specific application, we determine that a total of 20-38Mbps should be used at resolution 2160×1200@90 fps, and 22-42Mbps at 2560×1440@60 fps. The recommendations are given with the assumption that the image is split in two and streamed in parallel, since this is how the tested prototype operates. CCS CONCEPTS • Networks → Cloud computing; Network measurement; • Applied computing → Computer games; • Computing methodologies → Virtual reality.

show abstract

“…Cloud gaming video using importance factor weighted peak signal-to-noise ratio (IFWPSNR) was proposed as an extension of weighted peak signal-to-noise ratio (WPSNR), where important factor (IF) table was created in three steps by creating a list of all the activities, list the objects in each activity and record all the gaze point for each object in each activity [7]. Foveated video encoding (FVE) was used to reduce bandwidth requirements by applying real-time gaze tracking which decreases 10% to encode and transmits the game's data to the cloud gaming client [8] This kind of thing open new opportunity for people around the world to develop new kind of gaming mechanism and cloud system has become the new target for gaming world development. However, there are some obstacles that people have to overcome first before getting to a better cloud system.…”

Section: Previous Researchmentioning

confidence: 99%

Mobile cloud game in high performance computing environment

Kristiadi¹,

Sudarto²,

Rahardja

et al. 2020

TELKOMNIKA

View full text Add to dashboard Cite

Mobile cloud game is a solution to play high-end games in indigent thin clients with a diversity of end-user devices, and as real-time gaming, mobile cloud game hosting game engines in the cloud. Moreover, frequent change in network quality is another issue that should be limited to run the real fast cloud game. Thus, reliable software components between cloud and user devices as clients, including using artificial intelligence (AI) algorithms such as machine learning, deep learning and so on will enhance the game performance, particularly in multiplayer and real-time conditions. In this paper, we list the mobile cloud game architecture in the high-performance computing (HPC) environment, where a load of the game will be distributed between servers as cloud and clients. The server node as clouds or clients will consist of more than one server with many processors (cores) or sometimes can be recognized as distributed computing. Using HPC for cloud games will boost the game performance where the execution times will be dispersed not only in some node in servers and clients but in many cores of each server or client. The involvement of the internet of things (IoT) and ubiquitous access from heterogeneous devices will give benefit to enjoyment in the game itself.

show abstract

Cloud Gaming with Foveated Video Encoding

Cited by 52 publications

References 38 publications

Video Caching, Analytics, and Delivery at the Wireless Edge: A Survey and Future Directions

Video Caching, Analytics, and Delivery at the Wireless Edge: A Survey and Future Directions

Bitrate Requirements of Non-Panoramic VR Remote Rendering

Mobile cloud game in high performance computing environment

Contact Info

Product

Resources

About