Perceptual quality evaluation for texture and motion based video coding

Abstract

One approach that can be used to increase compression efficiency beyond the data rates achievable by state-of-the-art video codecs is to use content-based methods whereby not all the pixels are conventionally encoded. An approach to reduce the data rate is to use different coding methods for pixels belonging to areas containing large amount of detail that are costly to encode, for example textures. This can be extended by focusing on the semantic meaning of objects represented in the video sequence and also taking into consideration Human Visual System properties. The goal is to determine where "detail-irrelevant" regions are located in the frame and synthesize them with acceptable perceptual quality. In this paper, we discuss the effects and trade-offs of these techniques based on a set of perceptual experiments and analyze how these areas can influence the viewer's attention.

New context of compression problem and approach to solution: a survey of the literature

“…This method is however not effective for non-rigid texture objects and the frame-byframe synthesis can yield temporal inconsistencies. A similar texture synthesis technique based on texture analysis and segmentation using frame-to-frame mapping and edgebased inpainting was proposed in [135,136,141]. The authors claimed to achieve up to 35% bit rate saving compared to H.264 for the same visual quality.…”

“…The authors claimed to achieve up to 35% bit rate saving compared to H.264 for the same visual quality. The author in [135,136] however do not specify, how visual quality was assessed. The method presented by Oh et al [142] uses a low quality video as side information to synthesize the texture at the decoder.…”

“…72,130,131,132,133] and region-based approaches[65,134,135,136,137]. The block-based parametric approaches allows easy integration of synthesis based techniques into hybrid block-based codecs as H.264/AVC and HEVC while targeting a pixel-accurate reconstruction of the input signal.…”

How to Use Texture Analysis and Synthesis Methods for Video Compression

“…Over the past two decades, many promising region-based video coding methods have been developed [27][28][29][30][31][32][33][34][35][36] and thoroughly discussed in [4]. That is, a globally instead of an MSE accurate texture representation is aimed at.…”