A novel motion recovery using temporal and spatial correlation for a fast temporal error concealment over H.264 video sequences

Nam, Cholman; Chu, Changgon; Kim, Taeguk; Han, Sokmin

doi:10.1007/s11042-019-08176-x

Cited by 7 publications

(3 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Whenever network-layer packets get lost, corrupted Network Abstraction Unit (NAL) packets should be discarded entirely. Numerous error concealment algorithms have been and are being developed for H.264/AVC [12,13]. For more recent standards like H.265/HEVC and Versatile Video Coding (H.266/VVC), there is little work on error concealment techniques [14].…”

Section: Client-based Methodsmentioning

confidence: 99%

Keyframe Insertion: Enabling Low-Latency Random Access and Packet Loss Repair

et al. 2021

View full text Add to dashboard Cite

From a video coding perspective, there are two challenges when performing live video distribution over error-prone networks, such as wireless networks: random access and packet loss repair. There is a scarceness of solutions that do not impact steady-state usage and users with reliable connections. The proposed solution minimizes this impact by complementing a compression-efficient video stream with a companion stream solely consisting of keyframes. Although the core idea is not new, this paper is the first work to provide restrictions and modifications necessary to make this idea work using the High-Efficiency Video Coding (H.265/HEVC) compression standard. Additionally, through thorough quantification, insight is provided on how to provide low-latency fast channel switching capabilities and error recovery at low quality impact, i.e., less than 0.94 average Video Multimethod Assessment Fusion (VMAF) score decrease. Finally, worst-case drift artifacts are described and visualized such that the reader gets an overall picture of using the keyframe insertion technique.

show abstract

Section: Client-based Methodsmentioning

confidence: 99%

Keyframe Insertion: Enabling Low-Latency Random Access and Packet Loss Repair

et al. 2021

View full text Add to dashboard Cite

show abstract

“…However, these place a large bitrate burden on the client device, or can only slightly acommodate for low latencies. In case of a packet loss, i.e., corrupted Network Abstraction Layer Units (NALUs), client-based error concealment algorithms were developed for Advanced Video Coding (H.264/AVC) [6], [7], yet there is only a limited set of equivalent techniques for High Efficiency Video Coding (H.265/HEVC) [8] , let alone Versatile Video Coding (H.266/VVC) [9].…”

Section: Introductionmentioning

confidence: 99%

Mixed-Resolution HESP for More Efficient Fast Channel Switching and Packet-Loss Repair

Wallendael

Lambert

Speelmans³

et al. 2022

2022 Picture Coding Symposium (PCS)

View full text Add to dashboard Cite

Low-delay live streaming applications desire fast channel switching and packet-loss repair capabilities. However, existing methods that provide these capabilities have a negative impact on the stream of steady-state users. To minimize this impact, techniques such as the High Efficiency Streaming Protocol (HESP) utilize keyframe injection. Such techniques combine compression-efficient normal streams with corresponding companion streams that are used in case of random access or packet loss. Unfortunately, because a companion stream is needed for every normal stream, the distribution cost and encoding complexity are considerable costs. Additionally, injecting a companion keyframe into a normal stream causes a bitrate spike. Therefore, this paper evaluates the impact of utilizing mixedresolution keyframe injection in the H.266/VVC standard. By providing a single companion stream for all normal streams of a bitrate ladder, the three mentioned downsides can be mitigated. We found that injecting a lower-resolution keyframe effectively reduces the bitrate spike, at the cost of only a modest quality loss. For dynamic video content, the quality impact reduces over time, and is less perceptible than traditional packet-loss repair using frame copy. In conclusion, mixed-resolution HESP can reduce the bitrate spike and computational/distribution overhead of HESP when enabling fast channel switching or packet-loss repair.

show abstract

“…A delightful source coding candidate for wireless video communication is the compression efficient standard H.264 [ 37 , 38 , 39 , 40 ]. In [ 41 ], the authors proposed a mobile model called Proposed Generation (Pro-G) for supporting large number of user applications, making usage of wider bandwidth, adoptive modulation and coding for cellular systems.…”

Section: Introductionmentioning

confidence: 99%

On the Performance of Video Resolution, Motion and Dynamism in Transmission Using Near-Capacity Transceiver for Wireless Communication

Minallah

Ullah

Frnda

et al. 2021

Entropy

View full text Add to dashboard Cite

This article investigates the performance of various sophisticated channel coding and transmission schemes for achieving reliable transmission of a highly compressed video stream. Novel error protection schemes including Non-Convergent Coding (NCC) scheme, Non-Convergent Coding assisted with Differential Space Time Spreading (DSTS) and Sphere Packing (SP) modulation (NCDSTS-SP) scheme and Convergent Coding assisted with DSTS and SP modulation (CDSTS-SP) are analyzed using Bit Error Ratio (BER) and Peak Signal to Noise Ratio (PSNR) performance metrics. Furthermore, error reduction is achieved using sophisticated transceiver comprising SP modulation technique assisted by Differential Space Time Spreading. The performance of the iterative Soft Bit Source Decoding (SBSD) in combination with channel codes is analyzed using various error protection setups by allocating consistent overall bit-rate budget. Additionally, the iterative behavior of SBSD assisted RSC decoder is analyzed with the aid of Extrinsic Information Transfer (EXIT) Chart in order to analyze the achievable turbo cliff of the iterative decoding process. The subjective and objective video quality performance of the proposed error protection schemes is analyzed while employing H.264 advanced video coding and H.265 high efficient video coding standards, while utilizing diverse video sequences having different resolution, motion and dynamism. It was observed that in the presence of noisy channel the low resolution videos outperforms its high resolution counterparts. Furthermore, it was observed that the performance of video sequence with low motion contents and dynamism outperforms relative to video sequence with high motion contents and dynamism. More specifically, it is observed that while utilizing H.265 video coding standard, the Non-Convergent Coding assisted with DSTS and SP modulation scheme with enhanced transmission mechanism results in Eb/N0 gain of 20 dB with reference to the Non-Convergent Coding and transmission mechanism at the objective PSNR value of 42 dB. It is important to mention that both the schemes have employed identical code rate. Furthermore, the Convergent Coding assisted with DSTS and SP modulation mechanism achieved superior performance with reference to the equivalent rate Non-Convergent Coding assisted with DSTS and SP modulation counterpart mechanism, with a performance gain of 16 dB at the objective PSNR grade of 42 dB. Moreover, it is observed that the maximum achievable PSNR gain through H.265 video coding standard is 45 dB, with a PSNR gain of 3 dB with reference to the identical code rate H.264 coding scheme.

show abstract

A novel motion recovery using temporal and spatial correlation for a fast temporal error concealment over H.264 video sequences

Cited by 7 publications

References 24 publications

Keyframe Insertion: Enabling Low-Latency Random Access and Packet Loss Repair

Keyframe Insertion: Enabling Low-Latency Random Access and Packet Loss Repair

Mixed-Resolution HESP for More Efficient Fast Channel Switching and Packet-Loss Repair

On the Performance of Video Resolution, Motion and Dynamism in Transmission Using Near-Capacity Transceiver for Wireless Communication

Contact Info

Product

Resources

About