Visual attention modulates audiovisual speech perception

Integration of heard and seen speech: a factor in learning disabilities in children

“…In the most challenging listening conditions, the LDs may have attended primarily to the visual stimuli, in spite of the instructions to report what they heard. Support for this hypothesis can be found in recent work by Tiippana et al, showing that visual attention to the lips modulates perceptions of incongruent audiovisual speech [15].…”

Phonetic Recalibration in Audiovisual Speech

“…Other studies on audiovisual speech using this dual task have indeed found that an additional visual task (tracking a moving leaf over a speaking face) can interfere with lipreading (e.g., Tiippana, Andersen, & Sams, 2004), thus preventing any firm conclusion about whether attention affects cross-modal information integration rather than lipreading itself. A recent report on spatial attention (i.e., attending one out of two faces presented on the left and right of fixation) also confirms that endogenous attention affects lipreading rather than multisensory integration (Andersen, Tiippana, Laarni,…”

The processing of audio-visual speech: empirical and neural bases

“…2 Nevertheless, studies with adults suggest that there can be an attentional cost to processing audio-visual fusions of this sort. Tiippana et al (2004) and Alsius et al (2005) independently showed that a visual distractor task could reduce the incidence of illusory McGurk percepts. In Tiippana et al's study, the distractor element was a moving image of a leaf randomly floating across the face of the talker (but not obscuring the mouth).…”