Multifractal analysis of 3D video representation formats

Abstract

One of the main properties of a three-dimensional (3D) video is the large amount of data, which impose challenges for network transport of videos, in applications such as digital video broadcast (DVB), streaming over IP networks, or for transmission over mobile broadband. Addressing these challenges requires a thorough understanding of the characteristics and traffic properties of 3D video formats. We analyzed 3D video formats using publicly available long video frame-size traces of videos in full high definition (HD) resolution with two views. Examined 3D video representation formats are the multiview (MV) video format, the frame sequential (FS) format, and the side-by-side (SBS) format. We performed a multifractal analysis through extensive simulation and showed multifractal properties of 3D video representation formats. It was shown that the MV video had the highest multifractal nature, while the FS video had the lowest. Also, a part of the multifractal spectrum connected to the highest changes in the signal (high bitrate variability) is analyzed in detail. Changes in multifractal properties for different streaming approaches of 3D videos with aggregated frames are examined, as well as the influence of frame types and values of quantization parameters. Multifractal analysis was performed by the method of moments and by the histogram method.

Fractal and Multifractal Characterization of 3D Video Signals

“…An essential overview of 3D video representation and compression formats according to fractal and multifractal properties is given [19,25].…”

“…It is shown that the three main examined 3D video formats have a multifractal structure [23][24][25], as well as individual views in multiview 3D video format using the multifractal spectra. The implementation of the algorithm and the application of the histogram method using codes written in the MATLAB and Python [25] showed that MV video has the most pronounced multifractal structure for the most pronounced singularity (the largest part of the structure), while the least pronounced multifractal nature is present in FS video.…”

“…An overview of the fractal and multifractal properties of the 3D video format depending on the choice of frame type was given, which showed a great similarity of the multifractal properties of the intra-coded (I) frames of the 3D video format, which is a consequence of the similar coding principle of this type of frame, and which showed differences in the variability of frame types, especially pronounced for prediction (P) coded and bidirectional (B) coded frames for different 3D video formats, which is a consequence of different coding approaches, as well as the highest explosiveness of P-type frames [22,23,25].…”

“…Fractal and multifractal properties of 3D video representation formats in the case of frame aggregation and in different conditions of 3D video broadcasting were exposed with the aim of determining more efficient transmission, which showed a decrease in the expression of variability if only certain generalized dimensions or fractal self-similarity are observed, but an increase in explosiveness on a smaller to the part of the signal that is observed thanks to the multifractal spectrum [19,25].…”

“…Multifractal characterization of 3D video signals is given in Refs. [22][23][24][25]. It is shown that the most pronounced multifractal nature characterizes the MV video, while it is the least pronounced for the FS video.…”