[Paper] Design and Construction of Data Acquisition Facilities for Diminished Reality Research

Abstract

facilities to enable DR researchers ground truth data acquisition and evaluation workflow for quantitative evaluation of DR methods using the data. In this paper, our main target is OB-DR because IB-DR problems do not have a single solution represented as ground truth, i.e., solutions of IB-DR, in principle, are viewer-Abstract Diminished reality (DR) refers to interactive techniques for deleting or diminishing undesirable objects from a perceived environment, whereas augmented/mixed reality seamlessly merges a real and virtual scene. In this paper, we introduce data acquisition facilities and evaluation workflow towards DR method benchmark. In the proposed data acquisition facilities, simulated indoor and outdoor scenes are constructed, illumed, and photographed, using full-scale and miniature sets, a cinematography-based lighting system, and camera attached 6 degrees of freedom industrial robot arm respectively. Consequently, it facilitates acquisition of paired image sequence with and without target objects of interest, i.e., source and ground truth image sequences, to evaluate DR methods in indoor and outdoor scenarios. Through operations test, several datasets are recorded and test benches of DR methods are evaluated using the dataset to show that such data is usable for qualitative and quantitative evaluation of DR methods.

A survey of diminished reality: Techniques for visually concealing, eliminating, and seeing through real objects

“…However, to assess whether a resulting image is correct or not, we need the ground truth in DR. For example, the ground truth of the see-through process is the pair of an image sequence of an object to be removed and one without the object in the same spatial-temporal conditions. Focusing on a static background and a static target object, we can acquire such a set of image sequences with a robot arm under a fixed illumination condition [98]. However, assuming dynamic backgrounds or target objects, it is impossible to acquire such ground truth without guarantees of the repeatability of the backgrounds and targets.…”