Analytic Simplification of Neural Network Based Intra-Prediction Modes For Video Compression

Santamaría, María Paz Diago; Blasi, Saverio; Izquierdo, Ebroul; Mrak, Marta

doi:10.1109/icmew46912.2020.9106027

Cited by 8 publications

(5 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It stands as one of the fundamental technologies in video encoding. The absence of rate control in any video compression standard can severely constrain its practical application [29,30].…”

Section: Improving Video Streaming Quality For Specific Services In W...mentioning

confidence: 99%

Optimization of Video Transmission Quality in Wireless Networks

Țurcanu,

Țurcanu

2024

J. Eng. Sci.

View full text Add to dashboard Cite

The transmission of video stream over wireless networks is used by many applications and services, from the use of equipment in home communication networks to those carrying the video surveillance stream. Numerous technical challenges may arise when the unpredictable characteristics of the radio channel align or do not align with the stipulated requirements for transmission bandwidth and the necessary latency for transporting video data. All these challenges prevent users from experiencing smooth video streaming. Depending on the application scenarios, video service emphasis may vary according of Quality of Experience - QoE or parameter used traditionally in the networks, Quality of Service - QoS. The purpose of the research consists in optimization of the flow service, which ensures the adaptability of video communication to changes of conditions over the wireless computer network. As a result of a thorough analysis of the video playback characteristics related to the wireless channel, the most optimal approach in optimizing the quality of the video stream service over a wireless LAN requiring minimal modifications was identified, and namely system centric approach.

show abstract

“…It stands as one of the fundamental technologies in video encoding. The absence of rate control in any video compression standard can severely constrain its practical application [29,30].…”

Section: Improving Video Streaming Quality For Specific Services In W...mentioning

confidence: 99%

Optimization of Video Transmission Quality in Wireless Networks

Țurcanu,

Țurcanu

2024

J. Eng. Sci.

View full text Add to dashboard Cite

show abstract

“…In Fig. 8, the bit rate savings of the proposed switchable filter approach are plotted against the bits per pixel (bpp) needed to encode the first 31 inter-predicted frames of CTC and non-CTC video sequences, for 4 QPs (22,27,32,37) under the LDP configuration. As opposed to Tables II and III, the savings are calculated only for inter-coded frames and positive values indicate coding gains.…”

Section: F Evaluation On Higher Resolution Video Sequencesmentioning

confidence: 99%

“…Recent research in the context of NN-based prediction showed that linear network segments can be deployed in place of more complex schemes with advantages in terms of reducing the complexity of the inference process [21]. Application of linear segments has already been presented in the context of intra-prediction for video coding [22]. Furthermore, in previous work [8], a simplified CNN-based filtering process was proposed in the context of inter-prediction in VVC, as opposed to the approach in [14], [16], [20] which used HEVC as its baseline encoder.…”

Section: Introductionmentioning

confidence: 99%

Improved CNN-Based Learning of Interpolation Filters for Low-Complexity Inter Prediction in Video Coding

Murn¹,

Blasi²,

Smeaton

et al. 2021

IEEE Open J. Signal Process.

Self Cite

View full text Add to dashboard Cite

The versatility of recent machine learning approaches makes them ideal for improvement of next generation video compression solutions. Unfortunately, these approaches typically bring significant increases in computational complexity and are difficult to interpret into explainable models, affecting their potential for implementation within practical video coding applications. This paper introduces a novel explainable neural network-based inter-prediction scheme, to improve the interpolation of reference samples needed for fractional precision motion compensation. The approach requires a single neural network to be trained from which a full quarter-pixel interpolation filter set is derived, as the network is easily interpretable due to its linear structure. A novel training framework enables each network branch to resemble a specific fractional shift. This practical solution makes it very efficient to use alongside conventional video coding schemes. When implemented in the context of the state-of-the-art Versatile Video Coding (VVC) test model, 0.77%, 1.27% and 2.25% BD-rate savings can be achieved on average for lower resolution sequences under the random access, low-delay B and low-delay P configurations, respectively, while the complexity of the learned interpolation schemes is significantly reduced compared to the interpolation with full CNNs.

show abstract

“…At latter conversion of entropy is obtained by means of Huffman algorithm. Neural network based intra prediction linear model is built by [19,37] to demonstrate the performance of versatile video coding among conventional methods. Neural network combined with Gray Level Covariance Matrix (GLCM) [5] used for intra prediction with flexible quad tree CU.…”

Section: Intra Predictionmentioning

confidence: 99%

State-Of-The-Art In Video Processing: Compression, Optimization And Retrieval

Megala¹

2021

TURCOMAT

View full text Add to dashboard Cite

Video compression plays a vital role in the modern social media networking with plethora of multimedia applications. It empowers transmission medium to competently transfer videos and enable resources to store the video efficiently. Nowadays high-resolution video data are transferred through the communication channel having high bit rate in order to send multiple compressed videos. There are many advances in transmission ability, efficient storage ways of these compressed video where compression is the primary task involved in multimedia services. This paper summarizes the compression standards, describes the main concepts involved in video coding. Video compression performs conversion of large raw bits of video sequence into a small compact one, achieving high compression ratio with good video perceptual quality. Removing redundant information is the main task in the video sequence compression. A survey on various block matching algorithms, quantization and entropy coding are focused. It is found that many of the methods having computational complexities needs improvement with optimization.

show abstract

Analytic Simplification of Neural Network Based Intra-Prediction Modes For Video Compression

Cited by 8 publications

References 4 publications

Optimization of Video Transmission Quality in Wireless Networks

Optimization of Video Transmission Quality in Wireless Networks

Improved CNN-Based Learning of Interpolation Filters for Low-Complexity Inter Prediction in Video Coding

State-Of-The-Art In Video Processing: Compression, Optimization And Retrieval

Contact Info

Product

Resources

About