A study on keyframe injection in three generations of video coding standards for fast channel switching and packet-loss repair

Mareen, Hannes; Courteaux, Martijn; Speelmans, Pieter-Jan; Lambert, Peter; Wallendael, Glenn Van

doi:10.1007/s11042-023-17163-2

Cited by 3 publications

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Temporal Layer Injection for Fast Bitrate Ladder Creation in Video Live Streaming

Mareen,

Haems,

Wauters

et al. 2023

2023 IEEE International Symposium on Multimedia (ISM)

View full text Add to dashboard Cite

Video streaming systems aim to provide high-quality video adapted to clients' device and network conditions. For this purpose, adaptive streaming architectures encode video content at a variety of quality levels, organized in a bitrate ladder. However, compressing a video into multiple streams is resource-intensive, which may become especially problematic in live streaming applications with real-time demands. Therefore, this paper proposes a novel solution for fast bitrate ladder creation, and provides the requirements for implementation in the H.266/VVC standard. More specifically, the proposed method creates new intermediate Combined Streams by injecting the lowest temporal layers of a higher-quality Augmentation Stream in a lower-quality Base Stream. Since the lowest layers are used as reference by the remaining layers, this procedure indirectly increases the quality of the frames in those untouched remaining layers as well. We demonstrate that injecting more layers brings both the quality and bitrate closer to that of the Augmentation Stream. The disadvantage of the Combined Streams is that their quality fluctuates more than the quality of the source streams, and that they are compressed less efficiently, comparable to going from a slower to fast or faster preset in the VVenC encoder. Most importantly, their main advantage is that they were generated at no significant additional computational complexity. In this way, the proposed method is of great benefit when generating a bitrate ladder of video streams under constrained computational resources.

show abstract

Temporal Layer Injection for Fast Bitrate Ladder Creation in Video Live Streaming

Mareen,

Haems,

Wauters

et al. 2023

2023 IEEE International Symposium on Multimedia (ISM)

View full text Add to dashboard Cite

show abstract

P-Frame Injection for Efficient Packet-Loss Repair in Ultra-Low-Latency Video Streaming

Mareen,

Lambert,

Van Wallendael

2023

2023 IEEE International Conference on Visual Communications and Image Processing (VCIP)

Self Cite

View full text Add to dashboard Cite

Applications providing ultra-low-latency video streaming to large audiences require fast and efficient packetloss repair. Previous methods utilizing keyframe injection (such as the High Efficiency Streaming Protocol) have a low impact on the repaired stream quality, but at a cost of a significant bitrate spike during repair. In this paper, we propose injecting P-frames for packet-loss repair of ultra-low-latency streaming.We implemented (open-source) and evaluated our approach in both H.265/HEVC and H.266/VVC standards. Through extensive evaluations, we demonstrate that the proposed solution significantly reduces bitrate overhead while maintaining a similar or lower decrease in quality compared to existing packet-loss-repair techniques. Overall, the proposed approach offers a promising solution to ensure reliable packet-loss recovery, efficient resource utilization, and a high-quality streaming experience.

show abstract

Accelerated Bitrate Ladder Creation for Video Live Streaming Using Temporal Layer Injection

Mareen,

Haems,

Wauters

et al. 2024

Int. J. Semantic Computing

View full text Add to dashboard Cite

Video streaming systems aim to provide high-quality video adapted to clients’ device and network conditions. For this purpose, adaptive streaming architectures encode video content at a variety of quality levels, organized in a bitrate ladder. However, compressing a video into multiple streams is resource-intensive, which may become especially problematic in live streaming applications with real-time demands. Therefore, this paper proposes a novel solution for fast bitrate ladder creation, and provides the requirements for implementation in the H.266/VVC standard. More specifically, the proposed method creates new intermediate combined streams by injecting the lowest temporal layers of a higher-quality augmentation stream in a lower- quality base stream. Since the lowest layers are used as reference by the remaining layers, this procedure indirectly increases the quality of the frames in those untouched remaining layers as well. Although altering the reference frames may cause some drift-error artifacts, we demonstrate that, on average, the quality of the intermediate streams are higher than the base stream. Additionally, we demonstrate that injecting more layers brings both the quality and bitrate closer to that of the augmentation stream. The disadvantage of the combined streams is that their quality fluctuates more than the quality of the source streams, and that they are compressed less efficiently, comparable to going from a slower to fast or faster preset in the VVenC encoder. Most importantly, their main advantage is that they were generated at no significant additional computational complexity. In this way, the proposed method is of great benefit when generating a bitrate ladder of video streams under constrained computational resources. The code has been made open source and is available on https://github.com/IDLabMedia/NALUProcessing .

show abstract

A study on keyframe injection in three generations of video coding standards for fast channel switching and packet-loss repair

Cited by 3 publications

References 36 publications

Temporal Layer Injection for Fast Bitrate Ladder Creation in Video Live Streaming

Temporal Layer Injection for Fast Bitrate Ladder Creation in Video Live Streaming

P-Frame Injection for Efficient Packet-Loss Repair in Ultra-Low-Latency Video Streaming

Accelerated Bitrate Ladder Creation for Video Live Streaming Using Temporal Layer Injection

Contact Info

Product

Resources

About