No evidence from MVPA for different processes underlying the N300 and N400 incongruity effects in object-scene processing

Draschkow, Dejan; Heikel, Edvard; Võ, Melissa L.-H.; Fiebach, Christian J.; Sassenhagen, Jona

doi:10.1016/j.neuropsychologia.2018.09.016

Cited by 56 publications

(63 citation statements)

References 51 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Sensitivity to spatial structure emerged after 255 ms of processing, which is only after scene‐selective peaks in ERPs (Harel et al, ; Sato et al, ) and after basic scene attributes are computed (Cichy, Khosla, Pantazis, & Oliva, ). Interestingly, after 250 ms brain responses not only become sensitive to scene structure, but also to object‐scene consistencies (Draschkow et al, ; Ganis & Kutas, ; Mudrik et al, ; Võ & Wolfe, ). Together, these results suggest a dedicated processing stage for the structural analysis of objects, scenes, and their relationships, which is different from basic perceptual processing.…”

Section: Discussionmentioning

confidence: 99%

“…Related studies on object‐object and object‐scene consistencies typically yield large effect sizes which exceed this value, both for fMRI responses, d = 0.72 (Brandman & Peelen, ), d = 0.67 (Kaiser & Peelen, ), d = 2.14 (Kim & Biederman, ), d = 0.94 (Roberts & Humphreys, ), and EEG responses, d = 0.71 (Draschkow, Heikel, Võ, Fiebach, & Sassenhagen, ), d = 0.88 (Ganis & Kutas, ), d = 0.67 (Mudrik, Lamy, & Deouell, ), d = 0.69 (Võ & Wolfe, ).…”

mentioning

confidence: 99%

See 1 more Smart Citation

Cortical sensitivity to natural scene structure

Kaiser

Häberle

Cichy

2019

Human Brain Mapping

View full text Add to dashboard Cite

Natural scenes are inherently structured, with meaningful objects appearing in predictable locations. Human vision is tuned to this structure: When scene structure is purposefully jumbled, perception is strongly impaired. Here, we tested how such perceptual effects are reflected in neural sensitivity to scene structure. During separate fMRI and EEG experiments, participants passively viewed scenes whose spatial structure (i.e., the position of scene parts) and categorical structure (i.e., the content of scene parts) could be intact or jumbled. Using multivariate decoding, we show that spatial (but not categorical) scene structure profoundly impacts on cortical processing: Scene‐selective responses in occipital and parahippocampal cortices (fMRI) and after 255 ms (EEG) accurately differentiated between spatially intact and jumbled scenes. Importantly, this differentiation was more pronounced for upright than for inverted scenes, indicating genuine sensitivity to spatial structure rather than sensitivity to low‐level attributes. Our findings suggest that visual scene analysis is tightly linked to the spatial structure of our natural environments. This link between cortical processing and scene structure may be crucial for rapidly parsing naturalistic visual inputs.

show abstract

Section: Discussionmentioning

confidence: 99%

mentioning

confidence: 99%

Cortical sensitivity to natural scene structure

Kaiser

Häberle

Cichy

2019

Human Brain Mapping

View full text Add to dashboard Cite

show abstract

“…The preprocessing and analysis scripts for both experiments can be found as html files and as reproducible scripts (jupyter notebooks; (Kluyver et al, 2016) at https://github.com/SageBoettcher/identityTemplates. The preprocessing pipeline is modified from the analysis pipeline used by Draschkow and colleagues (Draschkow et al, 2018). All EEG data analysis was conducted in MNE-Python (Gramfort et al, 2013).…”

Section: Eeg Acquisition (Experiments 1 and 2)mentioning

confidence: 99%

One Thing Leads to Another: Anticipating Visual Object Identity Based on Associative-Memory Templates

et al. 2020

View full text Add to dashboard Cite

Probabilistic associations between stimuli afford memory templates that guide perception through proactive anticipatory mechanisms. A great deal of work has examined the behavioral consequences and human electrophysiological substrates of anticipation following probabilistic memory cues that carry spatial or temporal information to guide perception. However, less is understood about the electrophysiological substrates linked to anticipating the sensory content of events based on recurring associations between successive events. Here, we demonstrate behavioral and electrophysiological signatures of using associative-memory templates to guide perception, while equating spatial and temporal anticipation (experiments 1 and 2), as well as target probability and response demands (experiment 2). By recording the electroencephalogram in the two experiments (N= 55; 24 females), we show that two markers in human electrophysiology implicated in spatial and temporal anticipation also contribute to the anticipation of perceptual identity, as follows: attenuation of alpha-band oscillations and the contingent negative variation (CNV). Together, our results show that memory-guided identity templates proactively impact perception and are associated with anticipatory states of attenuated alpha oscillations and the CNV. Furthermore, by isolating object–identity anticipation from spatial and temporal anticipation, our results suggest a role for alpha attenuation and the CNV in specific visual content anticipation beyond general changes in neural excitability or readiness.SIGNIFICANCE STATEMENTProbabilistic associations between stimuli afford memory templates that guide perception through proactive anticipatory mechanisms. The current work isolates the behavioral benefits and electrophysiological signatures of memory-guided identity-based anticipation, while equating anticipation of space, time, motor responses, and task relevance. Our results show that anticipation of the specific identity of a forthcoming percept impacts performance and is associated with states of attenuated alpha oscillations and the contingent negative variation, extending previous work implicating these neural substrates in spatial and temporal preparatory attention. Together, this work bridges fields of attention, memory, and perception, providing new insights into the neural mechanisms that support complex attentional templates.

show abstract

“…In eventrelated potentials (ERPs), it is commonly found that scene-inconsistent objects elicit a larger negative brain response compared to consistent ones. This long-lasting negative shift typically starts as early as 200-250 ms after stimulus onset (Mudrik, Shalgi, Lamy, & Deouell, 2014;Draschkow, Heikel, Võ, Fiebach, & Sassenhagen, 2018) and has its maximum at frontocentral scalp sites, in contrast to the centroparietal N400 effect for words (e.g., Kutas & Federmeier, 2011). The effect was found when the object appeared at a cued location after the scene background was already shown (Ganis & Kutas, 2003), for objects that were photoshopped into the scene (Mudrik, Lamy, & Deouell, 2010;Mudrik, et al, 2014;Coco, Araujo, & Petersson, 2017), and for objects that were part of realistic photographs (Võ & Wolfe, 2013).…”

Section: Introductionmentioning

confidence: 94%

“…The earlier part of the negative response, usually referred to as N300, has been taken to reflect the context-dependent difficulty of object identification, whereas the later N400 has been linked to semantic integration processes after the object is identified (e.g., Dyck & Brodeur, 2015). The present study was not designed to differentiate between these two subcomponents, especially considering that their scalp distribution is strongly overlapping or even topographically indistinguishable (Draschkow et al, 2018). Thus, for reasons of simplicity, we will in most cases simply refer to all frontocentral negativities as "N400" in the current study, but this term is meant to include the earlier N300 part of the effect.…”

Section: Introductionmentioning

confidence: 99%

Fixation-related brain activity during semantic integration of object-scene information

Coco¹,

Nuthmann²,

Dimigen³

2018

Preprint

View full text Add to dashboard Cite

In vision science, a topic of great interest and considerable controversy is the processing of objects that are (in)consistent with the overall meaning of the scene in which they occur. How quickly can we access the semantic properties of objects and does this happen before the object is directly looked at? Here we brought novel evidences to this debate by co-registering eye-movements and EEG while participants freely explored photographs of indoor scenes. Each scene contained a target object that was either consistent or inconsistent with the scene context (e.g., toothpaste vs. flashlight in a bathroom). Eye-movement behaviour showed that inconsistent objects were not only more effortful to process (i.e., looked at longer), but also prioritized over consistent objects while they were still in extrafoveal vision (i.e., looked at earlier after scene onset). In fixation-related brain potentials (FRPs), we used a linear deconvolution technique to compare the activity elicited by semantically consistent versus inconsistent objects at scene onset (i.e. in the stimulus-locked ERP), during the target fixation (t), and during the preceding fixation (t-1). We demonstrate a fixation-related N300/N400 effect, whereby inconsistent objects elicited a larger negative shift of FRP activity than consistent objects, already at the pre-target fixation t-1 and throughout fixation t. Taken together, our results suggest that object meaning can be, at least partly, extracted in extrafoveal vision, and highlight how attentional and neural mechanisms can be simultaneously investigated to uncover the mechanisms of object-scene integration during natural viewing.

show abstract

No evidence from MVPA for different processes underlying the N300 and N400 incongruity effects in object-scene processing

Abstract: for valuable help with data collection. We thank Sage Boettcher for comments and discussion. We also would like to thank the two anonymous reviewers for their extremely constructive suggestions and comments.

Cited by 56 publications

References 51 publications

Cortical sensitivity to natural scene structure

Cortical sensitivity to natural scene structure

One Thing Leads to Another: Anticipating Visual Object Identity Based on Associative-Memory Templates

Fixation-related brain activity during semantic integration of object-scene information

Contact Info

Product

Resources

About