Graceful Quality Improvement in Wireless 360-Degree Video Delivery

Fuiihashi, Takuya; Kobavashi, Makoto; Endo, Kazuhiko; Saruwatari, Shunsuke; Kobayashi, Makoto; Watanabe, Takashi

doi:10.1109/glocom.2018.8647848

Cited by 6 publications

(6 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Section: B 360-degree Videomentioning

confidence: 99%

“…The studies [127]- [130] on soft delivery schemes focus on the quality optimization of the user's viewport in addition to cliff and leveling effect prevention. [127] is the first scheme for viewport-aware soft 360-degree video delivery. According to the viewing viewport, the sender first adopts pixel-wise power allocation to reduce the perceptual redundancy in 360degree video frames and then carries out the combination of one-dimensional DCT (1D-DCT) and spherical wavelet transform (SWT) as a decorrelation to utilize the redundancy in the sphere and time domains.…”

Section: B 360-degree Videomentioning

confidence: 99%

See 1 more Smart Citation

Soft Delivery: Survey on A New Paradigm for Wireless and Mobile Multimedia Streaming

Fujihashi¹,

Koike‐Akino²,

Watanabe³

2021

Preprint

Self Cite

View full text Add to dashboard Cite

The increasing demand for video streaming services is the key driver of modern wireless and mobile communications. For robust and high-quality delivery of video content over wireless and mobile networks, the main challenge is sending image and video signals to single and multiple users over unstable and diverse channel environments. To this end, many studies have designed digital-based video delivery schemes, which mainly consist of a sequence of digital-based coding and transmission schemes. Although digital-based schemes perform well when the channel characteristics are known in advance, significant quality degradation, known as cliff and leveling effects, often occurs owing to the fluctuating channel characteristics. To prevent cliff and leveling effects irrespective of the channel characteristics of each user, a new paradigm for wireless and mobile video streaming has been proposed. Soft delivery schemes skip the digital operations of quantization and entropy and channel coding while directly mapping the power-assigned frequency-domain coefficients onto the transmission symbols. This modification is based on the fact that the pixel distortion due to communication noise is proportional to the magnitude of the noise, resulting in graceful quality improvement, wherein quality is improved gradually, according to the wireless channel quality without any cliff and leveling effects. Herein, we present a comprehensive summary of soft delivery schemes. First, we provide a brief introduction on wireless and mobile video streaming. Second, we discuss the issues associated with conventional digital-based video delivery schemes. Third, an overview of soft delivery is presented, and then the state of the art in soft delivery is summarized by considering energy compaction, power allocation, bandwidth utilization, and packet loss resilience. Finally, an excursion on the extensions needed for immersive content and future research directions are provided.

show abstract

Section: B 360-degree Videomentioning

confidence: 99%

Section: B 360-degree Videomentioning

confidence: 99%

Soft Delivery: Survey on A New Paradigm for Wireless and Mobile Multimedia Streaming

Fujihashi¹,

Koike‐Akino²,

Watanabe³

2021

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…FreeCast [48] adopted 5D-DCT for multi-view plus depth and exploited a fitting function based on a Gaussian Markov random field model for metadata overhead reduction. [54] first considered soft delivery for 360-degree videos by using a combination of 1D-DCT and spherical wavelet transform. OmniCast [44] proposed two algorithms to find the block partition with the minimum 2D projection distortion for different sphere-to-plane projections.…”

Section: Soft Image/video Deliverymentioning

confidence: 99%

“…Although the existing studies [44], [54] have designed soft delivery schemes for 360-degree videos, they require a large amount of video traffic because they send the full resolution of the 360-degree videos. To reduce the traffic in the soft delivery of 360-degree videos, 360Cast+ only sends the predicted and extended viewports considering the potential viewport prediction error.…”

Section: Soft Image/video Deliverymentioning

confidence: 99%

360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos

Fujihashi

Saruwatari

et al. 2021

IEEE Access

Self Cite

View full text Add to dashboard Cite

The existing viewport-adaptive 360-degree video streaming schemes encode tiled 360degree videos with digital-based compression. However, these schemes cause a cliff effect wherein the headset video quality drops when the channel signal-to-noise ratio (SNR) falls below a certain threshold. To realize high-quality wireless 360-degree video streaming, we propose a novel viewport-adaptive soft delivery scheme for 360-degree videos, called 360Cast+. 360Cast+ skips the non-linear operations in digital-based streaming and adopts power allocation and analog modulation to achieve graceful video quality improvement in unstable wireless links. In particular, 360Cast+ integrates the human vision system (HVS) and projection distortion as a perceptual weight in power allocation operations. A near-optimal low-complexity subcarrier matching algorithm was also adopted to extend 360Cast+ to fading channel environments. To reduce the effect of the prediction error, 360Cast+ uses dynamic linear regression (DLR) to predict the future orientation and future prediction error to extract the extension area around a viewport. The evaluation results demonstrated that the proposed 360Cast+ provides sophisticated video quality irrespective of the prediction error and channel conditions in orthogonal frequency-division multiplexing (OFDM)-based systems. INDEX TERMS 360-degree video delivery, soft delivery, viewport adaptive

show abstract

“…However, it can have temporal quality fluctuations as the projection changes when the user moves their head, and it is rarely used in the literature because of the server-side memory requirements of storing several different projections with different encoding parameters. A third, even less common, solution in wireless channels is to transmit the video directly, using analog modulation after applying the Discrete Cosine Transform (DCT) [239]. This leads to a more graceful quality decrease than the sharp fall caused by digital transmission, but is not without its disadvantages, as the transmitter and receiver hardware need to be designed ad hoc.…”

Section: Viewport-dependent Streamingmentioning

confidence: 99%

A Survey on 360-Degree Video: Coding, Quality of Experience and Streaming

Chiariotti¹

2021

Preprint

View full text Add to dashboard Cite

The commercialization of Virtual Reality (VR) headsets has made immersive and 360 • video streaming the subject of intense interest in the industry and research communities. While the basic principles of video streaming are the same, immersive video presents a set of specific challenges that need to be addressed. In this survey, we present the latest developments in the relevant literature on four of the most important ones: (i) omnidirectional video coding and compression, (ii) subjective and objective Quality of Experience (QoE) and the factors that can affect it, (iii) saliency measurement and Field of View (FoV) prediction, and (iv) the adaptive streaming of immersive 360 • videos.The final objective of the survey is to provide an overview of the research on all the elements of an immersive video streaming system, giving the reader an understanding of their interplay and performance.

show abstract

Graceful Quality Improvement in Wireless 360-Degree Video Delivery

Cited by 6 publications

References 19 publications

Soft Delivery: Survey on A New Paradigm for Wireless and Mobile Multimedia Streaming

Soft Delivery: Survey on A New Paradigm for Wireless and Mobile Multimedia Streaming

360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos

A Survey on 360-Degree Video: Coding, Quality of Experience and Streaming

Contact Info

Product

Resources

About