Weak Multi-View Supervision for Surface Mapping Estimation

Abstract

Figure 1: Approach overview: Given (a) a dataset of multi-view images and segmentation masks of a category-specific object, along with (b) a single template mesh with UV coordinates, our method trains a network (c) exploiting information from multiple views using reprojection cycles and learn an instance-specific mesh using deformations. (d) At test time, our model predicts an instance-specific mesh and a surface mapping from a single image.