Video mosaics

Abstract

We present a method for creating a video mosaic, a twodimensional arrangement of small source videos (tiles) that suggests a larger, unified target video. We develop a distance measure to assess the match between source and target based on average color and also three-dimensional wavelet decomposition signatures in the YIQ color space. We also introduce a dynamic programming algorithm that automatically chooses the smaller tiling sub-sequences from a large collection of candidate source video sequences to best match the target video. After the selection process, the color in the tiling videos is automatically adjusted to better suggest the target video. Finally, our method also supports the use of different tiling shapes to create an additional level of visual interest.

LUX color transform for mosaic image rendering

“…Choosing a proper color space like LUX (instead of YIQ) is interesting to avoid the color correction post-processing step often used by other authors [2], [6]. We are currently investigating further the proper max-normalization that should be used with LUX for applications like image mosaics, involving color comparison between two images.…”

“…Moreover, the computation time of the color matching algorithm should be short, in order to have a fast enough creation procedure, which is the second contribution of this paper. Other issues, not dealt here, but addressed by researchers in the literature are the use of tiles with varying size and orientation (irregular dense tiling) in order to preserve also edge information [4], tiles and container of arbitrary shapes to make jigsaw image mosaics [5], or creation of video mosaics where not only color spatial coherence but also temporal coherence must be maintained [6]. The paper is organized as follows: in section II, we explain the principle of mosaic building, based on the optimization of a color matching algorithm.…”

State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video

“…The IB-AR literature describes optimized search strategies for expedited rendering of photomosaics [6] as well as alternative optimization strategies such as evolutionary search [14]. Klein et al [76] extended photomosaics to video, updating elements of the mosaic to approximate video content whilst penalizing frequent changes of a given tile to prevent flicker. Work approximating images with irregular tiles (e. g., jigsaw image mosaics [73]) can be considered extensions of photomosaicking.…”

Content-Aware Photo Collage Using Circle Packing

“…This can be dated back to the Jigsaw image mosaics [13], where image tiles of arbitrary shapes are used to compose a picture and video mosaics [14], a 2D arrangement of small source videos that suggests a larger, unified target video. The method introduced in [15] creates the Arcimboldo-like collage which represents an image with multiple thematicallyrelated cutouts from filtered Internet images.…”