An ERP Investigation of Object-Scene Incongruity

Guillaume, Fabrice; Tinard, Sophie; Baier, Sophia; Dufau, Stéphane

doi:10.1027/0269-8803/a000181

Cited by 11 publications

(11 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The N400 effect observed at the nouns in the home dialect of Experiment 1 had a broad scalp distribution, which was more frontally distributed relative to the standard central-parietal N400 effect observed in the other dialect conditions. Though more frontally distributed, this negativity effect was classified as N400 since it peaked around 400 ms, given that previous studies have also reported similar more frontally distributed N400 effects (Balconi & Caldiroli, 2011;Guillaume, Tinard, Baier, & Dufau, 2016;Kelly, Ward, Creigh, & Bartolotti, 2007;Nakano, Saron, & Swaab, 2010). The scalp distribution difference observed across the three dialect conditions in the present study suggests some differences in the neural basis of the N400 effects during lexical prediction, which needs to be examined further.…”

Section: The Facilitating Effect Of Semantic Context On the Processing Of Newly Available Wordssupporting

confidence: 53%

How does dialectal experience modulate anticipatory speech processing?

Ren

Zheng

et al. 2020

Journal of Memory and Language

View full text Add to dashboard Cite

Context-based predictions facilitate speech processing. However, details of predictive processing mechanisms and how factors like language experience shape facilitative processing remain debated. This electroencephalograph study aimed to shed light on these issues by investigating the effect of dialectal experience on lexical prediction. Stimulus sentences were produced in three Mandarin Chinese dialects (home dialect, familiar regional dialect, and unfamiliar regional dialect). Critical nouns varied between strong and weak predictability. Only when listening to the home dialect was an enhanced ERP deflection observed at the transitive verb before a strongly predictable object noun (compared to the weakly predictable condition); the ERP amplitude at the verb correlated significantly with the following noun's predictability. The predictable object nouns elicited a reduced N400 in all three dialects but only an additional reduction in N1 in the home dialect condition. Conjointly, our results suggest that effortful meaning computation may partially underlie anticipatory lexical processing and that language experience modulates the way lexical prediction facilitates the early stage of acoustic/phonological processing (in addition to the later stage of meaning integration).

show abstract

Section: The Facilitating Effect Of Semantic Context On the Processing Of Newly Available Wordssupporting

confidence: 53%

How does dialectal experience modulate anticipatory speech processing?

Ren

Zheng

et al. 2020

Journal of Memory and Language

View full text Add to dashboard Cite

show abstract

“…We used these separate and simultaneous presentations as a key manipulation to examine in what measure any semantic consistency effect requires low-level, perceptual relationships between the context and the object within the same image, or may arise exclusively from high-level guidance, independently from the actual and reciprocal organization of the context and the object in a unique percept. Moreover, and importantly, the simultaneous image presentation avoided any possible bias related to a priming effect (semantic preactivation) which may occur with sequential presentations (see also e.g., 7,15,16 ). Previous research has reported a semantic consistency categorization advantage for separate and simultaneous object images 26,27 , even after correcting for response bias, which appeared to explain only part of the effect 28 .…”

mentioning

confidence: 99%

Reciprocal semantic predictions drive categorization of scene contexts and objects even when they are separate

Leroy

Faure

Spotorno

2020

Sci Rep

View full text Add to dashboard Cite

Visual categorization improves when object-context associations in scenes are semantically consistent, thus predictable from schemas stored in long-term memory. However, it is unclear whether this is due to differences in early perceptual processing, in matching of memory representations or in later stages of response selection. We tested these three concurrent explanations across five experiments. At each trial, participants had to categorize a scene context and an object briefly presented within the same image (Experiment 1), or separately in simultaneous images (Experiments 2-5). We analyzed unilateral (Experiments 1, 3) and bilateral presentations (Experiments 2, 4, 5), and presentations on the screen's horizontal midline (Experiments 1-2) and in the upper and lower visual fields (Experiments 3, 4). In all the experiments, we found a semantic consistency advantage for both context categorization and object categorization. this shows that the memory for object-context semantic associations is activated regardless of whether these two scene components are integrated in the same percept. Our study suggests that the facilitation effect of semantic consistency on categorization occurs at the stage of matching the percept with previous knowledge, supporting the object selection account and extending this framework to an object-context reciprocal influence on matching processes (objectcontext selection account). Viewers are able to categorize visual images from a brief glance, in a few dozens of milliseconds 1. This ability is a central dimension of cognition 2 : We make sense of the world fundamentally by relating and differentiating its components in terms of known groups, or categories 3,4. This allows us to process large amounts of information, while minimizing cognitive costs, and perceive common structures of elements 4 , even within the complex scenes that characterize everyday visual world. These scenes are composed of multiple objects, organized within a background (the scene's context) following semantic and spatial rules, which define the plausibility of object occurrence in the scene and of the scene's layout, respectively 5. Object-context associations are at the core of the concept of "scene" and a key, omnipresent aspect in our visual experience. However, it is still unclear how they influence visual information processing, namely in which conditions and at what stage they operate. Many studies have focused on the plausibility of object occurrence and have shown better categorization performance in the case of consistent, expected associations than inconsistent, unexpected associations. This semantic consistency advantage has been mainly found for categorization of the objects (e.g., "parasol", "notebook") included in the scene 6-10 but also for the categorization of the scene's context 7,11,12 in terms of its gist 13 (e.g., "beach", "office"). Several studies using even-related potentials (ERPs) 14-18 have reliably reported a greater N400 evoked by inconsistent objects, and interpreted it as reflecti...

show abstract

“…This suggestion can explain the widely-reported disadvantage in identifying incongruent objects, both with respect to accuracy (e.g., Biederman et al, 1974;Boyce et al, 1989;Underwood, 2005) and to reaction times (e.g., Davenport & Potter, 2004;Palmer, 1975;Rieger et al, 2008). It is further strengthened by EEG findings, showing that the waveforms induced by congruent and incongruent scenes start to diverge in the N300 time window (200-300 ms after the scene had been presented) -if not earlier (Guillaume, Tinard, Baier, & Dufau, 2016), at which these matching procedures presumably take place, prior to object identification (Mudrik et al, 2010;Mudrik, Lamy, et al, 2014;Võ & Wolfe, 2013; though see Ganis &Kutas, 2003 andDemiral et al, 2012). Note however, that this model holds the ITC as the locus of object-context integration, at which the information from the PHC and PFC converge.…”

Section: Neural Correlates Of Object-context Integrationmentioning

confidence: 81%

Imaging object-scene integration in visible and invisible natural scenes

Faivre

Dubois

Schwartz

et al. 2017

Preprint

View full text Add to dashboard Cite

Integrating objects with their context is a key step in the interpretation of complex visual scenes.Humans can do this very quickly, yet the brain mechanisms that mediate this ability are not yet understood. Here, we used functional Magnetic Resonance Imaging (fMRI) to measure brain activity while participants viewed visual scenes depicting a person performing an action with an object that was either congruent or incongruent with the scene. Univariate and multivariate analyses revealed different activity for congruent compared to incongruent scenes in the lateral occipital complex, inferior temporal cortex, parahippocampal cortex, and prefrontal cortex, in line with existing models of scene processing. Importantly, and in contrast to previous studies, these activations could not be explained by task-induced conflicts. A secondary goal of this study was to examine whether object-context integration could occur in the absence of awareness, by comparing brain activity elicited by congruent vs. incongruent scenes that were suppressed from awareness using visual masking. We found no evidence for brain activity differentiating between congruent and incongruent invisible scenes. Overall, our results provide novel support for the roles of PHC and PFC in conscious object-context integration which cannot be explained by either low-level differences or task demands. Yet they further suggest that activity in these regions is decreased by visual masking to the point of becoming undetectable with our fMRI protocol.

show abstract

An ERP Investigation of Object-Scene Incongruity

Cited by 11 publications

References 38 publications

How does dialectal experience modulate anticipatory speech processing?

How does dialectal experience modulate anticipatory speech processing?

Reciprocal semantic predictions drive categorization of scene contexts and objects even when they are separate

Imaging object-scene integration in visible and invisible natural scenes

Contact Info

Product

Resources

About