Assisted Multi-view Stereo Reconstruction

Abstract

Abstract-Multi-view stereo reconstruction methods can provide impressive results in a number of applications. Nevertheless, when trying to apply the state-of-the-art methods in the case of a more structured 3D acquisition, the lack of feedback on the quality of the reconstruction during the photo shooting can be problematic. In this paper we present a framework for the assisted reconstruction from images of real objects. The framework is able to provide, in quasi-realtime, a sparse reconstruction of the scene, so that the user is able to spot the missing or problematic parts. Moreover, the framework is able to separate the object of interest from the background and suggests missing points of view to the user, without any previous knowledge of the shape of the scene and the acquisition path. This is obtained by analyzing the sparse reconstruction and the connection between the reconstructed points and the input images. The framework has been tested on a variety of practical cases, and it has proved to be effective not only to obtain more complete reconstructions, but also to reduce the number of images needed and the processing time for dense reconstruction.

ConstructAide

“…Such methods, including ours, are known as "incremental SfM" (adding one or a few photo(s) at time), and recent methods demonstrate improvements by solving the SfM problem at once [Crandall et al to appear]. Our method is also related to the user-guided SfM method of Dellepiane et al [2013], although the inputs and goals our systems are different (input comes in the form of taking additional photos to guide reconstruction).…”

A Shape-Adjusted Tridimensional Reconstruction of Cultural Heritage Artifacts Using a Miniature Quadrotor

“…The automated miniature flying camera succeeded in following the newly-defined trajectory and building a more detailed picture of the artifact while keeping a safe distance from it. The automatic generation of the second trajectory could also be pursued by a third one using finer approaches based on voxels and/or octree quantification until occlusion will be totally filled by the integration of a next-best view planning algorithm [23]. The quality of the final 3D reconstruction based on the two combined image sets was encouraging in comparison with the 3D model obtained with a manually-operated and heavy reflex camera; moreover, this first result still could be slightly improved adding a second camera to create a rigid block stereo pair system to help the dense matching process.…”

Multi-scale 3D rock-art recording

“…In contrast to this method, our proposed pipeline works with visual information only. Like our pipeline, the approach proposed by Dellepiane et al (2013) allows for user feedback in the form of a sparse pointcloud of the object of interest.…”