Attention and Vision in Language Processing

Mishra, Ramesh Kumar; Srinivasan, Narayanan; Huettig, Falk

doi:10.1007/978-81-322-2443-3

Cited by 20 publications

(2 citation statements)

References 316 publications

(401 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In our experiments we only measured looks to the target object, and thus there may have been other changes in behaviour that we missed. For example, Hintz and Huettig (2015) showed a change in fixation behaviour in more complex scenes. In the simpler experiments (simple line drawings in a grid), they showed that participants fixated on semantic and phonological competitors as the sentence unfolds.…”

Section: Error-based Learningmentioning

confidence: 99%

Do we predict upcoming speech content in naturalistic environments?

Heyselaar

Peeters

Hagoort

2018

Preprint

View full text Add to dashboard Cite

The ability to predict upcoming actions is a characteristic hallmark of cognition and therefore not surprisingly a central topic in cognitive science. It remains unclear, however, whether the predictive behaviour commonly observed in strictly controlled lab environments generalizes to rich, everyday settings. In four virtual reality experiments, we tested whether a well-established marker of linguistic prediction (i.e. anticipatory eye movements as observed in the visual world paradigm) replicated when increasing the naturalness of the paradigm by means of i) immersing participants in naturalistic everyday scenes, ii) increasing the number of distractor objects present, iii) manipulating the location of referents in central versus peripheral vision, and iv) modifying the proportion of predictable nounreferents in the experiment. Robust anticipatory eye movements were observed, even in the presence of 10 objects (hereby testing working memory) and when only 25% of all sentences contained a visually present referent (hereby testing error-based learning). The anticipatory effect disappeared, however, when referents were placed in peripheral vision. Together, our findings suggest that working memory may play an important role in predictive processing in everyday communication, but only in contexts where upcoming referents have been explicitly attended to prior to encountering the spoken referential act. Methodologically, our study confirms that ecological validity and experimental control may go hand in hand in future studies of human predictive behaviour.

show abstract

Section: Error-based Learningmentioning

confidence: 99%

Do we predict upcoming speech content in naturalistic environments?

Heyselaar

Peeters

Hagoort

2018

Preprint

View full text Add to dashboard Cite

show abstract

“…Further, we also avoided using distractor objects that were visually similar to the target objects. This is because previous studies have shown that listeners were more likely to look at distractors that share overlapping phonological or visual features with the targets than unrelated distractors (Hintz & Huettig, 2015;Huettig & McQueen, 2007). The position of the drawings was pseudo-randomised to ensure that the target object appeared in all four positions with equal probability.…”

Section: Methodsmentioning

confidence: 99%

Predicting (in)correctly: listeners rapidly use unexpected information to revise their predictions

Chow

Chen

2020

Language, Cognition and Neuroscience

View full text Add to dashboard Cite

Comprehenders can incorporate rich contextual information to predict upcoming input on the fly, and cues that conflict with their predictions are quickly detected. The present study examined whether and how comprehenders may revise their existing predictions upon encountering a prediction-inconsistent cue. We took advantage of the rich classifier system in Mandarin Chinese and tracked participants' eye-movements as they listened to sentences in which the final noun is preceded by a classifier which was either compatible with the most expected noun, incompatible with the most expected noun but indicative of another contextually suitable noun, or uninformative. We found that, upon hearing a predictioninconsistent classifier, listeners quickly directed their eye gaze away from the originally expected object and immediately onto the (initially) unexpected but contextually suitable object. This provides initial evidence that listeners can quickly use prediction-mismatching cues to revise their existing predictions on the fly.

show abstract

Frequency in Language

Divjak¹

2019

100

View full text Add to dashboard Cite

Attention and Vision in Language Processing

Cited by 20 publications

References 316 publications

Do we predict upcoming speech content in naturalistic environments?

Do we predict upcoming speech content in naturalistic environments?

Predicting (in)correctly: listeners rapidly use unexpected information to revise their predictions

Frequency in Language

Contact Info

Product

Resources

About