Spatially scalable video coding (SSVC in short) provides an efficient way to deliver one video at different resolutions. Based on the development of emerging High Efficiency Video Coding (HEVC), we propose a SSVC scheme to provide both single-loop and multi-loop solutions by enabling different inter-layer prediction mechanisms. Specifically, there are three basic inter-layer prediction modes, inter-layer intra, motion and residual prediction, which are first investigated for enhancement layer coding. These three modes provide a basic single-loop SSVC solution for low complexity applications. Beside the correlations explored in single-loop solution, we employ an extra patch learning-based prediction mode named P-mode to further improve coding performance. In P-mode, the temporal and spatial correlations of the reference frames are explored simultaneously by the visual patch-based learning and mapping at pixel level. These correlations help enhance the accuracy of the inter-layer frame prediction from the base-layer reconstruction within a multi-loop structure. The experimental results show the effectiveness of the proposed SSVC scheme compared with simulcast case.Index Terms-HEVC, scalable video coding, learning based patch mapping
INTRODUCTIONVideo applications become more and more popular with the rapid development in the Internet, mobile computing and wireless networking. Most of these applications involve different devices that have different screen resolutions and demands for different network bandwidths. The traditional video coding schemes cannot meet these various needs effectively. Spatially scalable video coding (SSVC in short) provides an attractive solution to these applications, since it enables a single bit stream to simultaneously serve various devices with different displaying resolutions and qualities.SSVC compresses video content into multiple layers, including one base layer at the lowest resolution and several enhancement layers at incremental higher resolutions. In contrast with the traditional video coding schemes, SSVC introduces a unique problem -how to explore the correlation
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.