Mesh based 3D shape deformation for image based rendering from uncalibrated multiple views

Abstract

In this paper, we present a method to improve the quality of synthesized new view images for Image Based Rendering approach from uncalibrated multiple views targeting the detailed texture objects. To deform 3D model using the information such as image texture and object silhouette, the difference between the real object and the reconstructed model is evaluated as a function of optimization problem. The refined model provides a quite accurate dense corresponding relation between the images, so that high quality image can be synthesized at arbitrary viewpoint. We also demonstrate the proposed method by showing new view images rendered by the proposed method.