Flowlab - An Interactive Tool for Editing Dense Image Correspondences

Klose, Felix; Ruhl, Kai; Lipski, Christian; Magnor, Marcus

doi:10.1109/cvmp.2011.13

Cited by 8 publications

(13 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…They range from relatively direct cut&paste tools [6] to shape-fitting approaches [23]. However, to the best of our knowledge, no existing multimedia authoring tool includes scene flow yet.…”

Section: Mm'15 October 26 -30 2015 Brisbane Australiamentioning

confidence: 99%

See 1 more Smart Citation

Interactive Scene Flow Editing for Improved Image-based Rendering and Virtual Spacetime Navigation

Ruhl

Eisemann²,

Hilsmann

et al. 2015

Proceedings of the 23rd ACM International Conference on Multimedia

View full text Add to dashboard Cite

High-quality stereo and optical flow maps are essential for a multitude of tasks in visual media production, e.g. virtual camera navigation, disparity adaptation or scene editing. Rather than estimating stereo and optical flow separately, scene flow is a valid alternative since it combines both spatial and temporal information and recently surpassed the former two in terms of accuracy. However, since automated scene flow estimation is non-accurate in a number of situations, resulting rendering artifacts have to be corrected manually in each output frame, an elaborate and time-consuming task. We propose a novel workflow to edit the scene flow itself, catching the problem at its source and yielding a more flexible instrument for further processing. By integrating user edits in early stages of the optimization, we allow the use of approximate scribbles instead of accurate editing, thereby reducing interaction times. Our results show that editing the scene flow improves the quality of visual results considerably while requiring vastly less editing effort.

show abstract

Section: Mm'15 October 26 -30 2015 Brisbane Australiamentioning

confidence: 99%

“…Current approaches use cut&paste on a flow field to match regions via perspective transformation and to recompute optical flow locally [6], or provide approximate correspondence regions which are then refined within further optimization [11], similar to our method.…”

Section: Related Workmentioning

confidence: 99%

Interactive Scene Flow Editing for Improved Image-based Rendering and Virtual Spacetime Navigation

Ruhl

Eisemann²,

Hilsmann

et al. 2015

Proceedings of the 23rd ACM International Conference on Multimedia

View full text Add to dashboard Cite

show abstract

“…While Zhang et al [6] directly work on the maps by letting the user correct existing disparity maps on key frames, other approaches work in the image domain and use sparse scribbles on the 2D images to define depth layers, using them as soft constraints in a global optimization framework which propagates them into per-pixel depth maps through the whole image or video sequence [11,12]. Similarly, other approaches use simple paint strokes to let the user set smoothness, discontinuity, and depth ordering constraints in a variational optimization framework [4,5,13].…”

Section: Related Work and Contributionmentioning

confidence: 99%

“…However, while increasingly being discussed in the research community [4][5][6], visual effects artists have not yet adopted user interaction with dense optical flowbased estimation methods.…”

Section: Introductionmentioning

confidence: 99%

Surface tracking assessment and interaction in texture space

Furch¹,

Hilsmann²,

Eisert³

2017

Comp. Visual Media

View full text Add to dashboard Cite

In this paper, we present a novel approach for assessing and interacting with surface tracking algorithms targeting video manipulation in postproduction. As tracking inaccuracies are unavoidable, we enable the user to provide small hints to the algorithms instead of correcting erroneous results afterwards. Based on 2D mesh warp-based optical flow estimation, we visualize results and provide tools for user feedback in a consistent reference system, texture space. In this space, accurate tracking results are reflected by static appearance, and errors can easily be spotted as apparent change. A variety of established tools can be utilized to visualize and assess the change between frames. User interaction to improve tracking results becomes more intuitive in texture space, as it can focus on a small region rather than a moving object. We show how established tools can be implemented for interaction in texture space to provide a more intuitive interface allowing more effective and accurate user feedback.

show abstract

“…Typical ways are specifying sparse ground control points which serve as ground truth to estimate the depth for the remaining pixels [20], providing approximate correspondences which can then be refined by the underlying correspondence algorithm [12,8,13], or by removing outliers for a better depth interpolation [2].…”

Section: Related Workmentioning

confidence: 99%

Cost volume-based interactive depth editing in stereo post-processing

Ruhl

Eisemann

Magnor

2013

Proceedings of the 10th European Conference on Visual Media Production

View full text Add to dashboard Cite

In the post production of a stereoscopic visual media production, high-quality depth or disparity maps are essential for a number of workflow components, from initial layer separation, over editing transfers, to the final depth compositing. With automatic depth estimation not being perfect, errors lead to increased manual efforts for the artist, e.g. by requiring additional rotoscoping on the footage. We propose to fix errors in the depth maps instead of in image space, since multiple workflow steps can benefit from improved depth information. Building upon recent advances in discrete real-time stereo estimation algorithms, we guide the artist by integrating the cost volume of a stereo matching estimation into the editing parameters. Our results improve on the good results of automated algorithms and provide an opportunity for user corrections in regions that have only partially correct estimates.

show abstract

Flowlab - An Interactive Tool for Editing Dense Image Correspondences

Cited by 8 publications

References 25 publications

Interactive Scene Flow Editing for Improved Image-based Rendering and Virtual Spacetime Navigation

Interactive Scene Flow Editing for Improved Image-based Rendering and Virtual Spacetime Navigation

Surface tracking assessment and interaction in texture space

Cost volume-based interactive depth editing in stereo post-processing

Contact Info

Product

Resources

About