Novel View Synthesis using Needle-Map Correspondence

Abstract

Interest in view interpolation and novel view synthesis is growing. In this paper we show how dense correspondence can be found between needle-maps generated using shape-from-shading, which in turn can be used to generate new needle-maps. From these we can produce novel intermediate views, and also estimates of how each intermediate view would look under different lighting conditions. The approach offers the prospect of creating large sets of realistic views of a scene under different viewing and lighting conditions from a small number of original images.

Smoothing of SFS Reconstructed Surface Based on Genetic Algorithm

“…With the rapid development of image processing and computer vision technology, shape from shading(SFS) [1][2] has been widely used in reverse engineering, face recognition and natural scenery simulation [3][4][5] as it is of simple operation, high efficiency and wide range of application. The bad points exist in the surface reconstruction and those points lead to poor surface smoothness because of image quality and defects of SFS approach itself.…”

Single image facial view synthesis using SFS

“…This has the advantage over traditional stereo techniques that any synthesised needle map can be rendered with novel lighting and reflectance properties, increasing the variety of novel views possible. Worthington [12] has extended this work by developing a true shape from shading based view synthesis approach by making use of the dense correspondence between needle-maps.…”

“…In [12] Worthington introduced an extension to the view interpolation technique of Scharstein [9]. Rather than using image gradients to find dense correspondences between two images, Worthington proposed using the surface normals generated by shape from shading.…”

“…The evidence measure, e, proposed by Worthington [12] utilised the inner, or dot, product between two surface normals to measure similarity:…”