Blind assessment for stereo images considering binocular characteristics and deep perception map based on deep belief network

Abstract

In recent years, blind image quality assessment in the field of 2D image/video has gained the popularity, but its applications in 3D image/video are to be generalized. In this paper, we propose an effective blind metric evaluating stereo images via deep belief network (DBN). This method is based on wavelet transform with both 2D features from monocular images respectively as image content description and 3D features from a novel depth perception map (DPM) as depth perception description. In particular, the DPM is introduced to quantify longitudinal depth information to align with human stereo visual perception. More specifically, the 2D features are local histogram of oriented gradient (HoG) features from high frequency wavelet coefficients and global statistical features including magnitude, variance and entropy. Meanwhile, the global statistical features from the DPM are characterized as 3D features. Subsequently, considering binocular characteristics, an effective binocular weight model based on multiscale energy estimation of the left and right images is adopted to obtain the content quality. In the training and testing stages, three DBN models for the three types features separately are used to get the final score. Experimental results demonstrate that the proposed stereo image quality evaluation model

[Retracted] 3D Virtual Reality Implementation of Tourist Attractions Based on the Deep Belief Neural Network

“…To sum up, many scholars have carried out a lot of research on the neural network, virtual reality, target recognition, target reconstruction, and so on [16][17][18][19][20][21][22]. Traditional algorithms such as SFM, which are used to realize 3D virtual reality of tourist attractions, are prone to information loss, feature omission, and low accuracy in target recognition and reconstruction; due to their large amount of calculation and poor adaptability, it directly affects tourists' 3D virtual reality experience in tourist attractions.…”

Autonomous Operation Method of Multi-DOF Robotic Arm Based on Binocular Vision

“…Tang et al proposed a method following the principle of binocular vision measurement applied to the deformation and strain measurement of concrete filled steel tube, and obtained good results [9]. Binocular vision measurement also plays an important role in many fields, such as mechanical manufacturing, image quality assessment, and path detection [10][11][12].…”

Extraction and investigation of biosignal features for visual discomfort evaluation

“…Research results on subjective evaluation of stereoscopic images, taken from IVY LAB 3D image database (Jung et al 2014(Jung et al , 2013, were analyzed in several works (Shao et al 2017;Xu et al 2018;Zhang et al 2016). In recent years, subjective evaluation was used as a reference for the development of objective assessment methods, based on the human visual system, binocular disparity evaluation, blur, spatial frequency (Jiang et al 2016;Yang et al 2019;Zhou et al 2018). Jiang et al (2017a,b), in their work, introduced disparity features, such as magnitude, contrast, dispersion, skewness, and also combined with the oscillatory activity of the middle temporal area, for the assessment of visual discomfort.…”