New Approaches to 3D Vision

Linton, Paul; Morgan, Michael J.; Read, Jenny C. A.; Vishwanath, Dhanraj; Creem-Regehr, Sarah H.; Domini, Fulvio

doi:10.1098/rstb.2021.0443

Cited by 5 publications

(4 citation statements)

References 348 publications

(504 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Considerable evidence suggests that 3D vision is not a metric 3D reconstruction; some models of 3D space involve non-Euclid visual spaces (Linton et al, 2022). For example, Erkelens (2021) proposes a projective model of visual space perception that, when applied to pictorial space, predicts how regular structures are spaced in paintings (Erkelens, 2016).…”

Section: Discussionmentioning

confidence: 99%

“…However, if human vision aimed to infer a veridical 3D scene from every picture, then many artistic styles might seem incomprehensible when they are ambiguous, inconsistent, or do not follow any apparent strict projection rules. In fact, recent theories of 3D vision suggest that the visual system does not aim to infer coherent 3D shape from the real world (Linton et al, 2022), and so we would not expect picture perception to do so either.…”

Section: Introductionmentioning

confidence: 95%

See 1 more Smart Citation

Toward a Theory of Perspective Perception in Pictures

Hertzmann

2023

Preprint

View full text Add to dashboard Cite

This paper reviews perspective perception in pictures, and proposes hypotheses for 3D shape and space perception in pictures, in which eye fixations and foveal vision play a central role. Perspective describes how painters and cameras produce 2D picture arrangements from observations of 3D space. Many past theories and experimental studies focus solely on linear perspective. Yet, these theories fail to explain many important perceptual phenomena in perspective, including the effectiveness of other approaches to projection; few classical paintings strictly obey linear perspective, nor do the best distortion-avoidance techniques for wide-angle computational photography. This paper hypothesizes a two-stage process for 3D vision, in which shape is locally interpreted for a current eye fixation in a picture, according to foveal vision, and a global interpretation of a picture arises from spatial relationships between these regions. This framework could provide new insight for understanding pictorial perception across many types of depiction and suggests new studies to explore these hypotheses.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 95%

Toward a Theory of Perspective Perception in Pictures

Hertzmann

2023

Preprint

View full text Add to dashboard Cite

show abstract

“…This suggests a very different approach to perceptual learning than currently employed in deep neural networks ( figure 13 ) (for a review, see the Introduction article to this issue [ 86 ]). On my account the input to perceptual learning would be depth from disparity (so something more than the 2D image input in [ 23 ]), but we would still have to learn the concept of 3D space as a space in which we move, and which contains 3D objects that persist across time (so something less than the innate 'geometry awareness' of [ 79 ]).…”

Section: Two-stage Theory Of Visual Processingmentioning

confidence: 99%

Minimal theory of 3D vision: new approach to visual scale and visual shape

Linton

2022

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

Since Kepler and Descartes in the early-1600s, vision science has been committed to a triangulation model of stereo vision. But in the early-1800s, we realized that disparities are responsible for stereo vision. And we have spent the past 200 years trying to shoe-horn disparities back into the triangulation account. The first part of this article argues that this is a mistake, and that stereo vision is a solution to a different problem: the eradication of rivalry between the two retinal images, rather than the triangulation of objects in space. This leads to a ‘minimal theory of 3D vision’, where 3D vision is no longer tied to estimating the scale, shape, and direction of objects in the world. The second part of this article then asks whether the other aspects of 3D vision, which go beyond stereo vision, really operate at the same level of visual experience as stereo vision? I argue they do not. Whilst we want a theory of real-world 3D vision, the literature risks giving us a theory of picture perception instead. And I argue for a two-stage theory, where our purely internal ‘minimal’ 3D percept (from stereo vision) is linked to the world through cognition. This article is part of a discussion meeting issue ‘New approaches to 3D vision’.

show abstract

“…Our visual perceptions begin with a flat two-dimensional (2D) image from which we must extract the embedded third dimension (see [ 1 ] for a recent review and [ 2 ] for a recent proposal). We are readily able to judge the scale (the physical size of the grain) of novel environments and the depth relations within them, even if they don’t contain familiar objects (e.g.…”

Section: Introductionmentioning

confidence: 99%

Blurring the boundary between models and reality: Visual perception of scale assessed by performance

2023

View full text Add to dashboard Cite

One of the primary jobs of visual perception is to build a three-dimensional representation of the world around us from our flat retinal images. These are a rich source of depth cues but no single one of them can tell us about scale (i.e., absolute depth and size). For example, the pictorial depth cues in a (perfect) scale model are identical to those in the real scene that is being modelled. Here we investigate image blur gradients, which derive naturally from the limited depth of field available for any optical device and can be used to help estimate visual scale. By manipulating image blur artificially to produce what is sometimes called fake tilt shift miniaturization, we provide the first performance-based evidence that human vision uses this cue when making forced-choice judgements about scale (identifying which of an image pair was a photograph of a full-scale railway scene, and which was a 1:76 scale model). The orientation of the blur gradient (relative to the ground plane) proves to be crucial, though its rate of change is less important for our task, suggesting a fairly coarse visual analysis of this image parameter.

show abstract

New Approaches to 3D Vision

Cited by 5 publications

References 348 publications

Toward a Theory of Perspective Perception in Pictures

Toward a Theory of Perspective Perception in Pictures

Minimal theory of 3D vision: new approach to visual scale and visual shape

Blurring the boundary between models and reality: Visual perception of scale assessed by performance

Contact Info

Product

Resources

About