Video compression with intra/inter mode switching and a dual frame buffer

Abstract

Video codecs that use motion compensation have recently achieved performance improvements from the use of intra/inter mode switching decisions within a ratedistortion framework. A separate development has involved the use of multiple frame prediction, in which more than one past reference frame is available for motion estimation. In this paper, we show that using a dual frame buffer (one short term frame and one long term frame available for prediction) together with intra/inter mode switching improves the compression performance of the coder. Also, we improve the mode switching algorithm with the use of half-pel motion vectors.

Quality metrics for measuring end-to-end distortion in packet-switched video communication systems

“…Work on resilient video coding and transmission for packet lossy networks has primarily focused on minimizing the average expected distortion for a frame (or group of frames) [6][7][8][9][10][11][12][13][14][15][16][17][18][19][20], [27]. In these approaches the end-to-end distortion is defined as…”

Error Concealment for Dual Frame Video Coding with Uneven Quality

“…We see that the omniscient concealer chooses the LT frame for concealment substantially less often when the LT frame is just a regular frame. In earlier work [14,15], we concluded that pulsing the quality of frames for use as long term reference frames can have a beneficial effect on lowering the overall average distortion of the sequence. Table 2 shows that pulsing the quality of long term reference frames can also provide an advantage for error concealment.…”

“…If the pulsed quality is too uneven, the effect may be irritating to the viewer. When used with restraint, it was shown in [14,15] that the pulsed quality provides an advantage in reducing the overall distortion of the dual frame coded sequence, while the pulsing itself is not perceptible. Since the high quality LT frame is attractive also for the concealer, pulsing the quality provides a concealment advantage to the decoder as well, which is equipped to take advantage of the high quality reference frames.…”

“…The LT reference can be selected in a number of ways; we used jump updating in which the LT reference frame varies from as recent as frame frames, and then jumps forward again. We refer to in [13] and was also used in [14,15].…”

“…In [14], the choice among these three was made using an optimal distortion estimation. In the current work, we choose between inter/intra coding using a similar method to ( [16], p. 178).…”