High fidelity reproductions of paintings provide new opportunities to museums in preserving and providing access to cultural heritage. This paper presents an integrated system which is able to capture and fabricate color, topography and gloss of a painting, of which gloss capturing forms the most important contribution. A 3D imaging system, utilizing stereo imaging combined with fringe projection, is extended to capture spatially-varying gloss, based on the effect of specular reflectance polarization. The gloss is measured by sampling the specular reflection around Brewster's angle, where these reflections are effectively polarized, and can be separated from the unpolarized, diffuse reflectance. Off-center gloss measurements are calibrated relative to the center measurement. Off-specular gloss measurements, following from local variation of the surface normal, are masked based on the height map and corrected. Shadowed regions, caused by the 3D relief, are treated similarly. The area of a single capture is approximately 180 mm × 90 mm at a resolution of 25 µm × 25 µm. Aligned color, height, and gloss tiles are stitched together off-line, registering overlapping color regions. The resulting color, height and gloss maps are inputs for the poly-jet 3D printer. Two paintings were reproduced to verify the effectiveness and efficiency of the proposed system. One painting was scanned four times, consecutively rotated by 90°, to evaluate the influence of the scanning system geometric configuration on the gloss measurement. Experimental results show that the method is sufficiently fast for practical application, i.e. to scan a whole painting within eight hours, during closing hours of a museum. The results can well be used for the purpose of physical reproduction and other applications needing first-order estimates of the appearance (e.g. conservation diagnostics and condition reports). Our method to extend appearance scanning with gloss measurements is a valuable addition in the quest for realistic reproductions, in terms of its practical applicability -number of images needed for reconstruction and speed -and its perceptual added value, when added to color and topography reproduction.Developments in 3D scanning and 3D printing systems provide new opportunities to create high-fidelity physical reproductions of paintings. Facsimiles (one-to-one reproductions simulating the artifact's appearance), are already made of artifacts like manuscripts, for instance to support storytelling in exhibitions, when the original is too fragile to show. Up to recently, copies with such likeness did not exist for paintings [13]. Facsimiles of paintings, in addition to the original artwork, can play a role in museums' missions of preserving as well as providing access to cultural heritage. Possible applications of scanning and reproduction include: Multi-modal documentation of an artwork (e.g. adding to high-resolution photography, infrared, and X-ray imaging, as shown in the Bosch Research and Conservation Project [30,43]), showing an artwo...