Entire Shape Acquisition Technique Using Multiple Projectors and Cameras with Parallel Pattern Projection

Abstract

In the present paper, we propose a one-shot scanning system consisting of multiple projectors and cameras for dense entire shape acquisition of a moving object. One potential application of the proposed system is to capture a moving object at a high frame rate. Since the patterns used for one-shot scanning are usually complicated, and the patterns interfere with each other if they are projected onto the same object, it is difficult to use multiple sets of patterns for entire shape acquisition. In addition, the overlapped areas of each object have gaps and errors are accumulated. As such, merged shapes are usually noisy and inconsistent. In order to address this problem, we propose a one-shot shape reconstruction method using a projector to project a static pattern of parallel lines of one or two colors. Since each projector projects only parallel lines with a small number of colors, these patterns are easily decomposed and detected even if the patterns are projected multiple times onto the same object. We also propose a multi-view reconstruction algorithm for the projector-camera system. In the experiment, we built a system consisting of six projectors and six cameras, and dense shapes of entire objects were successfully reconstructed.

One-Shot Entire Shape Scanning by Utilizing Multiple Projector-Camera Constraints of Grid Patterns

“…The basic method does not use the both constraints, X p ik p jk and Z p ik p il in Eq. (6). We tested to use either X or Z to compare with the proposed method that uses the both X and Z.…”

“…In doing so, it is necessary to recognize the correspondence between projector and detected pattern. While lines of multiple colors are projected for reconstruction from each projector in [6], the reconstruction with wave-grid pattern uses single-colored pattern for a projector. In this paper, we can therefore assign different colors for the projectors.…”

Dense 3D Reconstruction from High Frame-Rate Video Using a Static Grid Pattern

“…In this case, the constant vector b becomes nonzero because the plane shared by the two pencils of planes does not exist. The solution is uniquely calculated by x ¼ ðA > AÞ À1 A > b as proven in [28]. Since the 1D search is not necessary for the case of two projectors, both vertical and horizontal lines can be dense with uniform intervals, which improves the reconstruction of thin and small objects [28].…”

Multiview 3D profilometry using resonance-based decomposition and three-phase shift profilometry

“…In [9] a method using virtual cylinders was used to overcome the problem with complex shapes not being represented correctly with cylindrical transforms. Multiple projector methods were used in [10,11] for full field of view shape measurement. In [10], parallel colour de-Bruijn patterns projected from multiple projectors was used for full object detection, while a similar method was used in [11].…”

“…Multiple projector methods were used in [10,11] for full field of view shape measurement. In [10], parallel colour de-Bruijn patterns projected from multiple projectors was used for full object detection, while a similar method was used in [11]. However the method of Furukawa et al must necessarily use more views, as it requires the overlap of the patterns to estimate the shape.…”