Disparity in Context: Understanding how monocular image content interacts with disparity processing in human visual cortex

Duan, Yiran; Thatte, Jayant; Yaklovleva, Alexandra; Norcia, Anthony M.

doi:10.1016/j.neuroimage.2021.118139

Cited by 8 publications

(8 citation statements)

References 95 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Durand et al (2007) also found that macaque V1 orientation selectivity emerges 68 msecs earlier than disparity selectivity. This result has been replicated in human ERP responses, with a similar orientation-disparity lag of 50 msecs (Duan et al, 2021).…”

Section: Binocular Disparitysupporting

confidence: 55%

Category and Depth Discrimination in Real-World Scenes

Anderson¹

2022

Preprint

View full text Add to dashboard Cite

Visual understanding of real-world scenes is near-instantaneous. Humans can extracta wealth of information, including spatial structure, semantic category, and theidentity of embedded objects, from images viewed for fewer than 100 msecs. Visualprocessing has capacity limits, and, as a result, the computational processes thatunderlie this behaviour must be highly efficient. Computational theories of realworldscene perception model early image processing in various ways. In Chapter 1,I review these theories, and in Chapter 2, I review the role of depth cues in rapidvisual processing. This discussion reveals three problems: (i) Tests of the agreementbetween model predictions and human responses may be biased by the arbitrarychoice of category system, (ii) Current models posit that scene semantics isestimated from spatial structure properties, but empirical support for this position isinconsistent, and (iii) The time-course of depth estimation in real-world scenes ispoorly understood. To address these problems, three empirical papers are presentedin Chapters 3, 4, and 5. In Chapter 3, I propose and validate a novel clusteringalgorithm that can be applied to image databases to derive category systems forvisual experiments. In Chapters 3 and 4, I examine the relationship between spatialstructure and semantic information, and find little support for the position that spatialstructure properties inform semantic discrimination. In Chapters 4 and 5, Icharacterize the time-course of depth processing for images presented for <267msecs, and conclude that binocular disparity and elevation cues contribute to realworldperception shortly after image onset (<50 msecs). These findings are discussedtogether in Chapter 6. This thesis contributes to the evaluation of modern models ofreal-world scene perception, and helps to characterize how visual understandingunfolds over time.

show abstract

Section: Binocular Disparitysupporting

confidence: 55%

Category and Depth Discrimination in Real-World Scenes

Anderson¹

2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Other work on human disparity processing is consistent with the multi-stage model of proto-object formation and attention. By recording differences in ERPs between flat, zero disparity images and 3D images, the presence of disparity was found to modulate the response starting at 100 ms, but it was not until 150 ms that the magnitude of the difference potential predicted behavioral reaction time 40 . The corresponding value for the onset of disparity sensitivity in the current study is ~ 75 ms, and the onset of a task effect is 165–184 ms.…”

Section: Discussionmentioning

confidence: 96%

“…This peak is small and may thus have been difficult to record with conventional signal averaging and low-channel count recording approaches. Our filtering approach thus provides robust access to this earliest stage of disparity processing, situating the onset of disparity responses to be within ~ 25 ms of the onset of cortical response to image contrast (see 40 for detailed discussion).…”

Section: Discussionmentioning

confidence: 99%

Cognitive penetrability of scene representations based on horizontal image disparities

Chen

Kaestner

Norcia

2022

Sci Rep

View full text Add to dashboard Cite

The structure of natural scenes is signaled by many visual cues. Principal amongst them are the binocular disparities created by the laterally separated viewpoints of the two eyes. Disparity cues are believed to be processed hierarchically, first in terms of local measurements of absolute disparity and second in terms of more global measurements of relative disparity that allow extraction of the depth structure of a scene. Psychophysical and oculomotor studies have suggested that relative disparities are particularly relevant to perception, whilst absolute disparities are not. Here, we compare neural responses to stimuli that isolate the absolute disparity cue with stimuli that contain additional relative disparity cues, using the high temporal resolution of EEG to determine the temporal order of absolute and relative disparity processing. By varying the observers’ task, we assess the extent to which each cue is cognitively penetrable. We find that absolute disparity is extracted before relative disparity, and that task effects arise only at or after the extraction of relative disparity. Our results indicate a hierarchy of disparity processing stages leading to the formation of a proto-object representation upon which higher cognitive processes can act.

show abstract

“…Other work on human disparity processing is consistent with the multi-stage model of proto-object formation and attention. By recording differences in ERPs between flat, zero disparity images and 3D images, the presence of disparity was found to modulate the response starting at 100 msec, but it was not until 150 msec that the magnitude of the difference potential predicted behavioral reaction time 36 . The corresponding value for the onset of disparity sensitivity in the current study is ∼75 msec, and the onset of a task effect is 165-184.…”

Section: Discussionmentioning

confidence: 96%

“…This peak is small and may thus have been difficult to record with conventional signal averaging and low-channel count recording approaches. Our filtering approach thus provides robust access to this earliest stage of disparity processing, situating the onset of disparity responses to be within ~25 msec of the onset of cortical response to image contrast (see 36 for detailed discussion).…”

Section: Discussionmentioning

confidence: 99%

Cognitive penetrability of scene representations based on horizontal image disparities

Chen

Kaestner

Norcia

2022

Preprint

Self Cite

View full text Add to dashboard Cite

The structure of natural scenes is signaled by many visual cues. Principal amongst them are the binocular disparities created by the laterally separated viewpoints of the two eyes. Disparity cues are believed to be processed hierarchically, first in terms of local measurements of absolute disparity and second in terms of more global measurements of relative disparity that allow extraction of the depth structure of a scene. Psychophysical and oculomotor studies have suggested that relative disparities are particularly relevant to perception, whilst absolute disparities are not. Here, we compare neural responses to stimuli that isolate the absolute disparity cue with stimuli that contain additional relative disparity cues, using the high temporal resolution of EEG to determine the temporal order of absolute and relative disparity processing. By varying the observers' task, we assess the extent to which each cue is cognitively penetrable. We find that absolute disparity is extracted before relative disparity, and that task effects arise only at or after the extraction of relative disparity. Our results indicate a hierarchy of disparity processing stages leading to the formation of a proto-object representation upon which higher cognitive processes can act.

show abstract

Disparity in Context: Understanding how monocular image content interacts with disparity processing in human visual cortex

Cited by 8 publications

References 95 publications

Category and Depth Discrimination in Real-World Scenes

Category and Depth Discrimination in Real-World Scenes

Cognitive penetrability of scene representations based on horizontal image disparities

Cognitive penetrability of scene representations based on horizontal image disparities

Contact Info

Product

Resources

About