Creating various styles of animations using example-based filtering

Hashimoto, Ryota; Johan, Henry; Nishita, Tomoyuki

doi:10.1109/cgi.2003.1214488

Cited by 9 publications

(9 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Like Hashimoto et al [2003], we increase temporal coherency by guiding the synthesized texture using optical flow.…”

Section: Artistic Video Stylizationmentioning

confidence: 99%

“…Image analogies permit many effects including transfer of painterly styles by example. By-example video stylization was explored by Hashimoto et al [2003], Bousseau et al [2007], and Bénard et al [2013]. High-resolution was precluded in those works by computational cost.…”

Section: Related Workmentioning

confidence: 99%

“…See the supplemental video for the full results, which shows the result of stylization with several different styles. The video also includes a comparison with Hashimoto et al [2003], which takes 2 minutes per frame with a 352x240 video. Our method in contrast renders 1024x576 resolution videos at 1 frame/second.…”

Section: Artistic Video Stylizationmentioning

confidence: 99%

See 2 more Smart Citations

PatchTable

et al. 2015

View full text Add to dashboard Cite

[Hertzmann et al. 2001] AbstractThis paper presents a data structure that reduces approximate nearest neighbor query times for image patches in large datasets. Previous work in texture synthesis has demonstrated real-time synthesis from small exemplar textures. However, high performance has proved elusive for modern patch-based optimization techniques which frequently use many exemplar images in the tens of megapixels or above. Our new algorithm, PatchTable, offloads as much of the computation as possible to a pre-computation stage that takes modest time, so patch queries can be as efficient as possible. There are three key insights behind our algorithm: (1) a lookup table similar to locality sensitive hashing can be precomputed, and used to seed sufficiently good initial patch correspondences during querying, (2) missing entries in the table can be filled during precomputation with our fast Voronoi transform, and (3) the initially seeded correspondences can be improved with a precomputed knearest neighbors mapping. We show experimentally that this accelerates the patch query operation by up to 9× over k-coherence, up to 12× over TreeCANN, and up to 200× over PatchMatch. Our fast algorithm allows us to explore efficient and practical imaging and computational photography applications. We show results for artistic video stylization, light field super-resolution, and multiimage editing.

show abstract

“…Like Hashimoto et al [2003], we increase temporal coherency by guiding the synthesized texture using optical flow.…”

Section: Artistic Video Stylizationmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

PatchTable

et al. 2015

View full text Add to dashboard Cite

show abstract

“…Video EBR is challenging due to the problem of constraining patch choice to satisfy not only local and global spatial coherence terms but also temporal coherence. Hashimoto et al [50], for example, adopt optical flow as a guide to propagate choices over time.…”

Section: Texture By Analogymentioning

confidence: 99%

State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video

Kyprianidis

Collomosse

Wang

et al. 2013

IEEE Trans. Visual. Comput. Graphics

244

147

View full text Add to dashboard Cite

“…Cao et al [2011] use a comparable approach to stylize videos by relying on optical flow. Hashimoto et al [2003] and Haro [2003] applied the Image Analogies method to low-resolution video sequences, using motion estimation to increase temporal coherence. The results of these methods also exhibit sliding and popping artifacts, due to inaccurate motion estimation, lack of explicit handling of occlusion, and low overall resolution.…”

Section: Synthesis For Animationmentioning

confidence: 99%

Stylizing animation by example

Bénard

Cole²,

Kass³

et al. 2013

ACM Trans. Graph.

View full text Add to dashboard Cite

Figure 1: Frame 20 (right) to 34 (left) -top row: stylized animation; bottom row: input shaded images. The two extreme frames are keyframes painted by an artist. Our algorithm synthesized the in-between frames. Note the important variations in terms of shape and appearance (texture and color) during this sequence. The accompanying video illustrates the temporal behavior. AbstractSkilled artists, using traditional media or modern computer painting tools, can create a variety of expressive styles that are very appealing in still images, but have been unsuitable for animation. The key difficulty is that existing techniques lack adequate temporal coherence to animate these styles effectively. Here we augment the range of practical animation styles by extending the guided texture synthesis method of Image Analogies [Hertzmann et al. 2001] to create temporally coherent animation sequences. To make the method art directable, we allow artists to paint portions of keyframes that are used as constraints. The in-betweens calculated by our method maintain stylistic continuity and yet change no more than necessary over time.

show abstract

Creating various styles of animations using example-based filtering

Abstract: Abstract

Cited by 9 publications

References 16 publications

PatchTable

PatchTable

State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video

Stylizing animation by example

Contact Info

Product

Resources

About