A dataset of stereoscopic images and ground-truth disparity mimicking human fixations in peripersonal space

Canessa, Andrea; Gibaldi, Agostino; Chessa, Manuela; Fato, Marco; Solari, Fabio; Sabatini, Silvio P.

doi:10.1038/sdata.2017.34

Cited by 26 publications

(21 citation statements)

References 119 publications

(88 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Simulation parameters. The simulation parameters selected to obtain the results presented in Fig 1 were adapted from the simulation parameters reported in [39], which were originally tuned to perform on computer vision benchmarks [101][102][103][104]. Since the proposed algorithm is meant to model human stereo vision, not compete on computer vision benchmarks, we modified the simulation parameters to reflect the known properties of the human visual system.…”

Section: Plos Computational Biologymentioning

confidence: 99%

Near-optimal combination of disparity across a log-polar scaled visual field

et al. 2020

Self Cite

View full text Add to dashboard Cite

The human visual system is foveated: we can see fine spatial details in central vision, whereas resolution is poor in our peripheral visual field, and this loss of resolution follows an approximately logarithmic decrease. Additionally, our brain organizes visual input in polar coordinates. Therefore, the image projection occurring between retina and primary visual cortex can be mathematically described by the log-polar transform. Here, we test and model how this space-variant visual processing affects how we process binocular disparity, a key component of human depth perception. We observe that the fovea preferentially processes disparities at fine spatial scales, whereas the visual periphery is tuned for coarse spatial scales, in line with the naturally occurring distributions of depths and disparities in the real-world. We further show that the visual system integrates disparity information across the visual field, in a near-optimal fashion. We develop a foveated, log-polar model that mimics the processing of depth information in primary visual cortex and that can process disparity directly in the cortical domain representation. This model takes real images as input and recreates the observed topography of human disparity sensitivity. Our findings support the notion that our foveated, binocular visual system has been moulded by the statistics of our visual environment.

show abstract

Section: Plos Computational Biologymentioning

confidence: 99%

Near-optimal combination of disparity across a log-polar scaled visual field

et al. 2020

Self Cite

View full text Add to dashboard Cite

show abstract

“…We know the visual system allocates computational resources effectively by exploiting regularities of the natural environment (Field, 1987;Geisler, 2008). For example, the shape of the binocular horopter is consistent with the distribution of naturally occurring binocular disparities (Liu et al, 2008;Sprague et al, 2015;Canessa et al, 2017;Gibaldi et al, 2017a). This is a very useful adaptation because the neural computations involved in stereopsis are challenging.…”

Section: Introductionmentioning

confidence: 99%

Binocular Eye Movements Are Adapted to the Natural Environment

Gibaldi

Banks

2019

J. Neurosci.

Self Cite

View full text Add to dashboard Cite

Humans and many animals make frequent saccades requiring coordinated movements of the eyes. When landing on the new fixation point, the eyes must converge accurately or double images will be perceived. We asked whether the visual system uses statistical regularities in the natural environment to aid eye alignment at the end of saccades. We measured the distribution of naturally occurring disparities in different parts of the visual field. The central tendency of the distributions was crossed (nearer than fixation) in the lower field and uncrossed (farther) in the upper field in male and female participants. It was uncrossed in the left and right fields. We also measured horizontal vergence after completion of vertical, horizontal, and oblique saccades. When the eyes first landed near the eccentric target, vergence was quite consistent with the natural-disparity distribution. For example, when making an upward saccade, the eyes diverged to be aligned with the most probable uncrossed disparity in that part of the visual field. Likewise, when making a downward saccade, the eyes converged to enable alignment with crossed disparity in that part of the field. Our results show that rapid binocular eye movements are adapted to the statistics of the 3D environment, minimizing the need for large corrective vergence movements at the end of saccades. The results are relevant to the debate about whether eye movements are derived from separate saccadic and vergence neural commands that control both eyes or from separate monocular commands that control the eyes independently.

show abstract

“…The crystalline lens' tilt cancels out some of the aberrations caused by foveal displacement and the cornea's asphericity and produces nearly aberration-free perception near the visual axis [11,12]. Then, the adaptation to the natural environment's visual statistics can be achieved through the binocular eye's movements [35,42].…”

Section: Retinal Correspondence and Geometric Horoptersmentioning

confidence: 99%

A Geometric Theory Integrating Human Binocular Vision with Eye movement

Turski

2020

Preprint

View full text Add to dashboard Cite

A theory of the binocular system with asymmetric eyes (AEs) is developed in the framework of bicentric perspective projections. The AE accounts for the eyeball’s global asymmetry produced by the foveal displacement from the posterior pole, the main source of the eye’s optical aberrations, and the crystalline lens’ tilt countering some of these aberrations. In this theory, the horopter curves, which specify retinal correspondence of binocular single vision, are conic sections resembling empirical horopters. This advances the classic model of empirical horopters as conic sections introduced in an ad hoc way by Ogle in 1932. In contrast to Ogle’s theory, here, anatomically supported horopteric conics vary with the AEs’ position in the visual plane of bifoveal fixations and their transformations are visualized in a computer simulation. Integrating horopteric conics with eye movements can help design algorithms for maintaining a stable perceptual world from visual information captured by a mobile robot’s camera-head. Further, this paper proposes a neurophysiologically meaningful definition for the eyes’ primary position, a concept which has remained elusive despite its theoretical importance to oculomotor research. Finally, because the horopteric conic’s shape is dependent on the AE’s parameters, this theory allows for changes in retinal correspondence which is usually considered preformed and stable.

show abstract

A dataset of stereoscopic images and ground-truth disparity mimicking human fixations in peripersonal space

Cited by 26 publications

References 119 publications

Near-optimal combination of disparity across a log-polar scaled visual field

Near-optimal combination of disparity across a log-polar scaled visual field

Binocular Eye Movements Are Adapted to the Natural Environment

A Geometric Theory Integrating Human Binocular Vision with Eye movement

Contact Info

Product

Resources

About