Lagrangian Multiplier Adaptation for Rate-Distortion Optimization With Inter-Frame Dependency

Li, Shuai; Zhu, Ce; Gao, Yanbo; Zhou, Yimin; Dufaux, Frédéric; Sun, Ming–Ting

doi:10.1109/tcsvt.2015.2450131

Cited by 76 publications

(39 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…where i QP and f QP represent the quantization parameter of the i-th coding tree unit and the frame level QP, and ∆QP denotes the QP offset. Specifically, according our previous work in [8,9], the coding performance of an I frame may have a strong impact on that of the following frames. Therefore, we also set a QP offset to the I frame in this paper, which can be expressed as have 600 frames at a frame rate of 30fps, and have resolution of 720x576.…”

Section: Object Based Qp Adaptation Strategymentioning

confidence: 99%

“…Such multiple QP optimization scheme will definitely increase the coding complexity since the video codec needs extra time to find the best QP from the QP candidates. In our previous work [8][9], we investigated a RDO scheme taking the inter-frame dependency into account, where the impact of coding performance of the current coding unit on that of the following frames is considered.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Video analytical coding: When video coding meets video analysis

Liu

Zhu

Mao

et al. 2018

Signal Processing: Image Communication

Self Cite

View full text Add to dashboard Cite

Leveraging on the properties of human visual system, most of the well-designed video coding standards utilize rate-distortion optimization techniques by maximizing a fidelity cost function (e.g. peak signal noise ratio, PSNR) under an available bit rate budget constrain. However, a huge amount of video data is consumed by computers rather than by human beings in several application scenarios. In view of this, this paper proposes a new coding framework called video analytical coding (VAC) for video analysis. We use the term "analytical distortion" to denote the difference of video analysis performance when video quality degrades and analytical distortion is estimated by compression distortion. Meanwhile, we develop a new rate-analytical-distortion optimization (RADO) method to trade off the bit rate and the analytical distortion. Specifically, we consider moving object detection as the analysis task and develop a novel rate analytical distortion (RAD) model and a quantization parameter adaptation strategy for video coding, where the analytical distortion is related to the object detection performance represented as F1measure. Experimental results show that the performance of the video analysis task can be significantly improved (up to 40% reduction of analytical distortion).

show abstract

Section: Object Based Qp Adaptation Strategymentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Video analytical coding: When video coding meets video analysis

Liu

Zhu

Mao

et al. 2018

Signal Processing: Image Communication

Self Cite

View full text Add to dashboard Cite

show abstract

“…A suitable Lagrange multiplier was found by sweeping from 0 to ∞; it is not clear how this can be done efficiently, and what is the termination condition when a sufficiently good multiplier value is found. [19] also adopted a Lagrangian approach, where the value of the Lagrange multiplier λ is empirically modeled as a function of the rate and the distortion when data units are predictively encoded. There is no guarantee that this ad-hoc approach will result in the optimal multiplier value upon termination, however.…”

Section: Discrete Lagrangian Formulationmentioning

confidence: 99%

Optimal Lagrange multipliers for dependent rate allocation in video coding

Abreu

Cheung

Frossard

et al. 2018

Signal Processing: Image Communication

View full text Add to dashboard Cite

In a typical video rate allocation problem, the objective is to optimally distribute a source rate budget among a set of (in)dependently coded data units to minimize the total distortion of all units. Conventional Lagrangian approaches convert the lone rate constraint to a linear rate penalty scaled by a multiplier in the objective, resulting in a simpler unconstrained formulation. However, the search for the "optimal" multiplier-one that results in a distortion-minimizing solution among all Lagrangian solutions that satisfy the original rate constraint-remains an elusive open problem in the general setting.To address this problem, we propose a computation-efficient search strategy to identify this optimal multiplier numerically. Specifically, we first formulate a general rate allocation problem where each data unit can be dependently coded at different quantization parameters (QP) using a previous unit as predictor, or left uncoded at the encoder and subsequently interpolated at the decoder using neighboring coded units. After converting the original rateconstrained problem to the unconstrained Lagrangian counterpart, we design an efficient dynamic programming (DP) algorithm that finds the optimal Lagrangian solution for a fixed multiplier. Finally, within the DP framework, we iteratively compute neighboring singular multiplier values, each resulting in multiple simultaneously optimal Lagrangian solutions, to drive the rates of the computed Lagrangian solutions towards the bit budget. We terminate when a singular multiplier value results in two Lagrangian solutions with rates below and above the bit budget. In extensive monoview and multiview video coding experiments, we show that, for fixed target rate constraints, our DP algorithm and selection of optimal multipliers on average outperform comparable rate control solutions used in video compression standards such as HEVC that do not skip frames in Y-PSNR. Index TermsLagrangian optimization, video and multiview image coding, rate-distortion (RD) optimization.A. De Abreu and P. Frossard are with Signal Processing Laboratory (LTS4), Ecole Polytechnique Fédérale de Lausanne (EPFL),

show abstract

“…It is worthy to note that the Lagrangian multiplier new λ in (6) is quite different that the λ defined in (4). In order to distinguish the two different Lagrangian multipliers new λ and λ , the Lagrangian λ in (4) will be denoted as HM λ in the remaining of this paper.…”

Section: B Rate Analytical Distortion Optimizationmentioning

confidence: 99%

“…peak signal to noise ratio, PSNR) at a given bit rate, with human beings as the target audience. Besides, there are many developed rate-distortion optimization (RDO) schemes for HEVC standard [1]- [4]. However, applying the traditional RDO scheme during video compression may be suboptimal when the video is intended for machine analysis.…”

Section: Introductionmentioning

confidence: 99%

Analytical distortion aware video coding for computer based video analysis

Liu

Zhu

Mao

et al. 2017

2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP)

Self Cite

View full text Add to dashboard Cite

With the development of artificial intelligence, more and more multimedia applications for various tasks have emerged in our daily life. Meanwhile, as one of the main information sources of the applications, a huge amount of video data has been being generated by portable or mounted cameras in daily basis for varying purposes including surveillance, in which case we may need computers to "watch" videos to save labor cost. However, most video coding standards are designed for the highest human perceptual quality given a bit rate by minimizing a fidelity cost function (e.g., mean squared error, MSE), assuming the content will be consumed by human beings. In view of the above considerations, this paper proposes a new rate-analytical-distortion optimization method (RADO) for video analysis. Specifically, we consider moving object detection as the analysis task. Accordingly, we develop a novel rate analytical distortion (RAD) model for video coding, where the analytical distortion is related to the object detection performance expressed in terms of F-measure. As shown in the experimental results, the performance of the video analysis task can be significantly improved (up to 40% reduction of analytical distortion) with a slight bit rate increase.

show abstract

Lagrangian Multiplier Adaptation for Rate-Distortion Optimization With Inter-Frame Dependency

Cited by 76 publications

References 16 publications

Video analytical coding: When video coding meets video analysis

Video analytical coding: When video coding meets video analysis

Optimal Lagrange multipliers for dependent rate allocation in video coding

Analytical distortion aware video coding for computer based video analysis

Contact Info

Product

Resources

About