Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning)

Campbell, Ruth; MacSweeney, Mairéad; Surguladze, Simon; Calvert, Gemma A.; McGuire, Philip; Suckling, John; Brammer, Michael; David, Anthony S.

doi:10.1016/s0926-6410(01)00054-4

Cited by 194 publications

(163 citation statements)

References 37 publications

Supporting

Mentioning

132

Contrasting

Order By: Relevance

“…These motor and premotor activations are in accordance with previous studies on auditory, visual, and audiovisual speech perception showing a key role of motor regions in speech processing (e.g., d'Ausilio et al, 2009d'Ausilio et al, , 2011Sato et al, 2009Sato et al, , 2010Möttönen & Watkins, 2009;Meister et al, 2007;Skipper et al, 2005Skipper et al, , 2007Pekkola et al, 2006;Pulvermuller et al, 2006;Wilson & Iacoboni, 2006;Ojanen et al, 2005;Callan et al, 2003Callan et al, , 2004Watkins & Paus, 2004;Wilson et al, 2004;Calvert & Campbell, 2003;Watkins et al, 2003;Campbell et al, 2001;Calvert et al, 2000). It is worthwhile noting that, in this study, participants were only asked to attentively listen to and/or watch speech stimuli.…”

Section: Visuo-lingual and Visuo-facial Speech Stimuli Share A Commonsupporting

confidence: 91%

“…Such modulations would represent the physiological correlates of the perceptual changes experienced after multisensory integration (e.g., Beauchamp, 2005;Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004;Beauchamp, Lee, Argall, & Martin, 2004;Calvert et al, 2000). In addition, premotor and motor cortices, known to play a crucial role in speech production, might also play a key role in audiovisual integration mechanisms in speech perception (e.g., Sato, Buccino, Gentilucci, & Cattaneo, 2010;Watkins & Paus, 2004;Calvert & Campbell, 2003;Watkins, Strafella, & Paus, 2003;Campbell et al, 2001). From that view, colleagues (2005, 2007) observed stronger activation in speech motor regions during audiovisual speech perception, compared with auditory and visual unimodal conditions.…”

Section: Motor Resonance Extends To Speech Actionmentioning

confidence: 99%

“…In line with previous studies, our results also showed stronger activity within the auditory cortex during lip reading condition than in the visuo-lingual condition. It was indeed demonstrated that syllables' visual cues are sufficient to activate auditory cortical sites, normally engaged during the perception of heard speech, in the absence of auditory speech sound (Campbell et al, 2001;Calvert et al, 1997). This result suggests a direct matching between the visible articulatory movements and auditory representation of the perceived syllables/phonemes.…”

Section: Neural Specificity Of Visuo-lingual and Visuo-facial Processingmentioning

confidence: 99%

See 2 more Smart Citations

Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions

Treille

Vilain

Hueber

et al. 2017

Journal of Cognitive Neuroscience

View full text Add to dashboard Cite

Abstract■ Action recognition has been found to rely not only on sensory brain areas but also partly on the observer's motor system. However, whether distinct auditory and visual experiences of an action modulate sensorimotor activity remains largely unknown. In the present sparse sampling fMRI study, we determined to which extent sensory and motor representations interact during the perception of tongue and lip speech actions. Tongue and lip speech actions were selected because tongue movements of our interlocutor are accessible via their impact on speech acoustics but not visible because of its position inside the vocal tract, whereas lip movements are both "audible" and visible. Participants were presented with auditory, visual, and audiovisual speech actions, with the visual inputs related to either a sagittal view of the tongue movements or a facial view of the lip movements of a speaker, previously recorded by an ultrasound imaging system and a video camera. Although the neural networks involved in visual visuo-lingual and visuo-facial perception largely overlapped, stronger motor and somatosensory activations were observed during visuo-lingual perception. In contrast, stronger activity was found in auditory and visual cortices during visuo-facial perception. Complementing these findings, activity in the left premotor cortex and in visual brain areas was found to correlate with visual recognition scores observed for visuo-lingual and visuo-facial speech stimuli, respectively, whereas visual activity correlated with RTs for both stimuli. These results suggest that unimodal and multimodal processing of lip and tongue speech actions rely on common sensorimotor brain areas. They also suggest that visual processing of audible but not visible movements induces motor and visual mental simulation of the perceived actions to facilitate recognition and/or to learn the association between auditory and visual signals. ■

show abstract

Section: Visuo-lingual and Visuo-facial Speech Stimuli Share A Commonsupporting

confidence: 91%

Section: Motor Resonance Extends To Speech Actionmentioning

confidence: 99%

Section: Neural Specificity Of Visuo-lingual and Visuo-facial Processingmentioning

confidence: 99%

See 1 more Smart Citation

Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions

Treille

Vilain

Hueber

et al. 2017

Journal of Cognitive Neuroscience

View full text Add to dashboard Cite

show abstract

“…This area also corresponds anatomically well with an STS area specifically responding to the observation of mouth movements observed in different studies from different labs (47)(48)(49)(50).…”

Section: Discussionsupporting

confidence: 74%

Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas

Carr

Iacoboni

Dubeau

et al. 2003

Proc. Natl. Acad. Sci. U.S.A.

1,692

1,180

View full text Add to dashboard Cite

How do we empathize with others? A mechanism according to which action representation modulates emotional activity may provide an essential functional architecture for empathy. The superior temporal and inferior frontal cortices are critical areas for action representation and are connected to the limbic system via the insula. Thus, the insula may be a critical relay from action representation to emotion. We used functional MRI while subjects were either imitating or simply observing emotional facial expressions. Imitation and observation of emotions activated a largely similar network of brain areas. Within this network, there was greater activity during imitation, compared with observation of emotions, in premotor areas including the inferior frontal cortex, as well as in the superior temporal cortex, insula, and amygdala. We understand what others feel by a mechanism of action representation that allows empathy and modulates our emotional content. The insula plays a fundamental role in this mechanism.

show abstract

“…For example, relative to scrambled point-light control stimuli, point-light displays of whole-body movements are known to activate EBA (Downing et al, 2001;Michels et al, 2005;Peelen et al, 2006) and fusiform cortex (Grossman and Blake, 2002;Grossman et al, 2004;Santi et al, 2003), with the latter activation most probably reflecting modulation of FBA rather than of FFA (Peelen et al, 2006). Fusiform cortex, including FFA, is also sensitive to facial motion in fully illuminated moving images (Campbell et al, 2001;Fox et al, 2009;Schultz and Pilz, Point-Light Faces and Bodies 4 2009). However, to the best of our knowledge only one published fMRI study has examined neural responses to point-light displays of facial motion, which reported fusiform activation for point-light body movements but not for point-light facial speech movements (Santi et al, 2003).…”

Section: Introductionmentioning

confidence: 99%

Modulation of the face- and body-selective visual regions by the motion and emotion of point-light face and body stimuli

2012

View full text Add to dashboard Cite

(2012) 'Modulation of the face-and body-selective visual regions by the motion and emotion of point-light face and body stimuli.', Neuroimage., 59 (2). pp. 1700-1712.Further information on publisher's website:https://doi.org/10.1016/j.neuroimage. 2011.08.073 Publisher's copyright statement: NOTICE: this is the author's version of a work that was accepted for publication in NeuroImage. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reected in this document. Changes may have been made to this work since it was submitted for publication. A denitive version was subsequently published in NeuroImage, 59/2, 2012NeuroImage, 59/2, , 10.1016NeuroImage, 59/2, /j.neuroimage.2011 Additional information: Use policyThe full-text may be used and/or reproduced, and given to third parties in any format or medium, without prior permission or charge, for personal research or study, educational, or not-for-prot purposes provided that:• a full bibliographic reference is made to the original source • a link is made to the metadata record in DRO • the full-text is not changed in any way The full-text must not be sold in any format or medium without the formal permission of the copyright holders.Please consult the full DRO policy for further details. This latter finding strongly constrains the claim that emotionally expressive movements modulate precisely those neuronal populations that code for the viewed stimulus category.

show abstract

Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning)

Cited by 194 publications

References 37 publications

Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions

Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions

Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas

Modulation of the face- and body-selective visual regions by the motion and emotion of point-light face and body stimuli

Contact Info

Product

Resources

About