Prediction in the service of comprehension: Modulated early brain responses to omitted speech segments

Bendixen, Alexandra; Scharinger, Mathias; Strauß, Antje; Obleser, Jonas

doi:10.1016/j.cortex.2014.01.001

Cited by 66 publications

(88 citation statements)

References 108 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In other words, it seems that anticipation processes allow a memory trace of a word to be created prior presentation. This is in line with studies showing context effects on the processing of missing or degraded speech (Bendixen, Scharinger, StrauB, & Obleser, 2014;Groppe et al, 2010;Sivonen et al, 2006;Sohoglu, Peelle, Carlyon, & Davis, 2012;Windmann, 2004). For instance, studies have shown that a word can be perceived as "intact" even though a phoneme is missing if it is preceded by an informative context; this phenomenon called phoneme restoration refers to the fact that people can falsely perceive or "hallucinate" a phoneme that is missing (Groppe et al, 2010;Sivonen et al, 2006;Warren, 1970), which supports the idea that top-down information is used during speech processing.…”

Section: Discussionsupporting

confidence: 89%

How do you know I was about to say “book”? Anticipation processes affect speech processing and lexical recognition

Foucart

Ruiz-Tada

Costa

2015

Language, Cognition and Neuroscience

View full text Add to dashboard Cite

Most event-related brain potential (ERP) studies that showed the role of anticipation processes during sentence processing focused on reading. However, in everyday conversation speech unfolds at higher speed; the present study examines whether comprehenders anticipate words when processing auditory sentences. In high-constrained Spanish sentences, we timelocked ERPs on the article preceding the critical noun, which was muted to avoid overlapping effects. Articles that mismatched the gender of the expected nouns triggered an early (200-280 ms) and a late negativity (450-900 ms), suggesting that anticipation processes are at play also during speech processing. A subsequent lexical recognition task revealed that (muted) "expected" words were (falsely) recognised significantly more often than (muted) "unexpected" words, and as often as "old words that were actually presented. These results suggest that anticipation processes allow creating a memory trace of a word prior to presentation. The findings support a top-down view of spoken sentence comprehension.

show abstract

Section: Discussionsupporting

confidence: 89%

How do you know I was about to say “book”? Anticipation processes affect speech processing and lexical recognition

Foucart

Ruiz-Tada

Costa

2015

Language, Cognition and Neuroscience

View full text Add to dashboard Cite

show abstract

“…For the coregistration of the EEG electrode positions we used, due to the nonavailability of individual anatomic models for our participants, a standard electrode layout, a standard MRI template, and a standard head model (based on the boundary-elements method) from FieldTrip software (Oostenveld et al, 2003). Reconstruction of sources from EEG data based on template anatomical models has been successfully performed by previous studies from our own group and others (for instance, Praamstra et al, 2006; Bendixen et al, 2014; Strauß et al, 2014; Helfrich et al, 2017). …”

Section: Methodsmentioning

confidence: 99%

Tracking Temporal Hazard in the Human Electroencephalogram Using a Forward Encoding Model

Herbst

Fiedler

Obleser

2018

eNeuro

Self Cite

View full text Add to dashboard Cite

Human observers automatically extract temporal contingencies from the environment and predict the onset of future events. Temporal predictions are modeled by the hazard function, which describes the instantaneous probability for an event to occur given it has not occurred yet. Here, we tackle the question of whether and how the human brain tracks continuous temporal hazard on a moment-to-moment basis, and how flexibly it adjusts to strictly implicit variations in the hazard function. We applied an encoding-model approach to human electroencephalographic data recorded during a pitch-discrimination task, in which we implicitly manipulated temporal predictability of the target tones by varying the interval between cue and target tone (i.e. the foreperiod). Critically, temporal predictability either was driven solely by the passage of time (resulting in a monotonic hazard function) or was modulated to increase at intermediate foreperiods (resulting in a modulated hazard function with a peak at the intermediate foreperiod). Forward-encoding models trained to predict the recorded EEG signal from different temporal hazard functions were able to distinguish between experimental conditions, showing that implicit variations of temporal hazard bear tractable signatures in the human electroencephalogram. Notably, this tracking signal was reconstructed best from the supplementary motor area, underlining this area’s link to cognitive processing of time. Our results underline the relevance of temporal hazard to cognitive processing and show that the predictive accuracy of the encoding-model approach can be utilized to track abstract time-resolved stimuli.

show abstract

“…Predictive coding is an optimal inference framework based on the idea that the brain internalizes forward models (how world events lead to sensory consequences), and that what travels from the sensory periphery to the brain are prediction errors (Rao & Ballard, 1999). The presence of predictive mechanisms in auditory and audio-visual speech processing has been shown experimentally (Bendixen, Scharinger, Strauß, & Obleser, 2014;Gagnepain, Henson, & Davis, 2012;Sohoglu, Peelle, Carlyon, & Davis, 2012;Van Wassenhove, 2013) and explored at the theoretical level (Yildiz, von Kriegstein, & Kiebel, 2013). The model we present involves predictive mechanisms in audio-visual speech synthesis and, unlike previous works (Bejjanki, Clayards, Knill, & Aslin, 2011;Magnotti & Beauchamp, 2014;Magnotti, Ma, & Beauchamp, 2013;Massaro, 1998;Omata & Mogi, 2008;Yildiz et al, 2013), takes into account the dynamic processing of both acoustic and visual information.…”

Section: Introductionmentioning

confidence: 99%

Prediction across sensory modalities: A neurocomputational model of the McGurk effect

Olasagasti

Bouton

Giraud

2015

Cortex

View full text Add to dashboard Cite

Audiovisual integrationComputational modeling McGurk effect a b s t r a c tThe McGurk effect is a textbook illustration of the automaticity with which the human brain integrates audio-visual speech. It shows that even incongruent audiovisual (AV) speech stimuli can be combined into percepts that correspond neither to the auditory nor to the visual input, but to a mix of both. Typically, when presented with, e.g., visual /aga/ and acoustic /aba/ we perceive an illusory /ada/. In the inverse situation, however, when acoustic /aga/ is paired with visual /aba/, we perceive a combination of both stimuli, i.e., /abga/ or /agba/. Here we assessed the role of dynamic cross-modal predictions in the outcome of AV speech integration using a computational model that processes continuous audiovisual speech sensory inputs in a predictive coding framework. The model involves three processing levels: sensory units, units that encode the dynamics of stimuli, and multimodal recognition/identity units. The model exhibits a dynamic prediction behavior because evidence about speech tokens can be asynchronous across sensory modality, allowing for updating the activity of the recognition units from one modality while sending topedown predictions to the other modality. We explored the model's response to congruent and incongruent AV stimuli and found that, in the two-dimensional feature space spanned by the speech second formant and lip aperture, fusion stimuli are located in the neighborhood of congruent /ada/, which therefore provides a valid match. Conversely, stimuli that lead to combination percepts do not have a unique valid neighbor. In that case, acoustic and visual cues are both highly salient and generate conflicting predictions in the other modality that cannot be fused, forcing the elaboration of a combinatorial solution.We propose that dynamic predictive mechanisms play a decisive role in the dichotomous perception of incongruent audiovisual inputs.

show abstract

Prediction in the service of comprehension: Modulated early brain responses to omitted speech segments

Cited by 66 publications

References 108 publications

How do you know I was about to say “book”? Anticipation processes affect speech processing and lexical recognition

How do you know I was about to say “book”? Anticipation processes affect speech processing and lexical recognition

Tracking Temporal Hazard in the Human Electroencephalogram Using a Forward Encoding Model

Prediction across sensory modalities: A neurocomputational model of the McGurk effect

Contact Info

Product

Resources

About