Comfort-driven disparity adjustment for stereoscopic video

Abstract

Pixel disparity-the offset of corresponding pixels between left and right views-is a crucial parameter in stereoscopic three-dimensional (S3D) video, as it determines the depth perceived by the human visual system (HVS). Unsuitable pixel disparity distribution throughout an S3D video may lead to visual discomfort. We present a unified and extensible stereoscopic video disparity adjustment framework which improves the viewing experience for an S3D video by keeping the perceived 3D appearance as unchanged as possible while minimizing discomfort. We first analyse disparity and motion attributes of S3D video in general, then derive a wide-ranging visual discomfort metric from existing perceptual comfort models. An objective function based on this metric is used as the basis of a hierarchical optimisation method to find a disparity mapping function for each input video frame. Warping-based disparity manipulation is then applied to the input video to generate the output video, using the desired disparity mappings as constraints. Our comfort metric takes into account disparity range, motion, and stereoscopic window violation; the framework could easily be extended to use further visual comfort models. We demonstrate the power of our approach using both animated cartoons and real S3D videos.

Inpainting of Wide-Baseline Multiple Viewpoint Video

“…Multiple viewpoint video (MVV) inpainting has received little attention. Literature addresses only the narrow baseline case, typically that of stereo pairs [16,25,32,34,35,40]. Given the small extent of the area to be filled, approaches approximate missing content by extrapolating adjacent colourdepth information and performing patch matching over the extrapolated pixels.…”

Widening Viewing Angles of Automultiscopic Displays Using Refractive Inserts

“…Typically, errors are analyzed in the resulting binocular disparity using lightfield theory [15]. Although disparity remapping is less relevant for an automultiscopic display, aberrations in the displayed lightfield (and hence parallax) will lead to perceptual inconsistencies [45]. Typical tools for the analysis of lightfield displays include viewing zone analysis of multi-view display [7] and frequency domain analysis [18], which have resulted in improvements for antialiasing of automultiscopic displays [53], content adaptive lenticular [43] prints, etc.…”

Gradient‐Guided Local Disparity Editing

“…Wang et al . [WZL*16] and Kellnhofer et al . [KDM*16] propose different methods to modify disparity globally in order to enhance depth perception in certain areas of an image pair or stereoscopic video.…”