Visual contribution to the multistable perception of speech

Sato, Marc; Basirat, Anahita; Schwartz, Jean‐Luc

doi:10.3758/bf03192952

Cited by 16 publications

(18 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, a previous verbal transformation experiment using the same material showed that the main organization of the reported transformations for both speech sequences was that of a pairwise coupling between /pata/ and /tapa/ syllables, although various others transformations were reported (Sato et al, 2007b). From these results, the reported transformations in the present study are likely to be strongly linked to a syllabic parsing process, rather than to auditory streaming or lexical competition mechanisms, as also sometimes observed in verbal transformations (see Sato et al, 2006Sato et al, , 2007aSato et al, , 2007b.…”

Section: Discussionsupporting

confidence: 73%

Parieto-frontal gamma band activity during the perceptual emergence of speech forms

et al. 2008

Self Cite

View full text Add to dashboard Cite

The multistable perception of speech refers to the perceptual changes experienced while listening to a speech form cycled in rapid and continuous repetition, the so-called Verbal Transformation Effect. Because distinct interpretations of the same repeated stimulus alternate spontaneously, this effect provides an invaluable tool to examine how speech percepts are formed in the listener's mind. In order to track the temporal dynamics of brain activity specifically linked to perceptual changes, intracerebral EEG activity was recorded from two implanted epileptic patients while performing a verbal transformation task. To this aim, they were asked to carefully listen to a speech sequence played repeatedly and to press a button whenever they perceived a change in the repeated utterance. For both patients, 300-800 ms prior to the reported perceptual transitions, high frequency activity in the gamma band range (> 40 Hz) was observed within the left inferior frontal and supramarginal gyri. An additional auditory decision task was used to rule out the possibility that the increased gamma band activity was due to the patients' motor responses. These results suggest that articulatory-based representations play a key part in the endogenously driven emergence of auditory speech percepts. The findings are interpreted in relation to theories assuming a link between perception and action in the human speech processing system.

show abstract

Section: Discussionsupporting

confidence: 73%

Parieto-frontal gamma band activity during the perceptual emergence of speech forms

et al. 2008

Self Cite

View full text Add to dashboard Cite

show abstract

“…In the VVTE, discovered by Sato et al [27, experiment 1], as we look at images of moving lips that we see as speaking a /ps e /, we eventually see it as saying /s e p/. Sato et al [27] found that reversals in the VVTE occurred in synchrony with reversals in the AVTE.…”

Section: Bindingmentioning

confidence: 99%

Multistability, cross-modal binding and the additivity of conjoined grouping principles

Kubovy

2012

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

We present a sceptical view of multimodal multistability-drawing most of our examples from the relation between audition and vision. We begin by summarizing some of the principal ways in which audio-visual binding takes place. We review the evidence that unambiguous stimulation in one modality may affect the perception of a multistable stimulus in another modality. Crossmodal influences of one multistable stimulus on the multistability of another are different: they have occurred only in speech perception. We then argue that the strongest relation between perceptual organization in vision and perceptual organization in audition is likely to be by way of analogous Gestalt laws. We conclude with some general observations about multimodality.

show abstract

“…These results confirmed that with this task, the perception of the repeated word in the sequence could be manipulated while keeping the acoustic signal constant. Volitional control also limited the biases observed during spontaneous bistable perception in which participants typically report hearing mainly one word repeated in the sequence and not the two bistable percepts in balance (see Basirat et al 2012;Sato et al 2007). …”

Section: Volitional Maintenance Of Conscious Speech Perceptsmentioning

confidence: 99%

“…Four auditory sequences (adapted from Basirat et al 2012 andSato et al 2007) were presented binaurally to participants via Etymotic earphones (Etymotic Research, Elk Grove Village, IL) at a comfortable hearing level. One sequence consisted of the repetition of the monosyllabic French word "lampe" ([lãp], French equivalent of "lamp").…”

Section: Experimental Paradigmmentioning

confidence: 99%

“…In this experiment, we were interested in understanding whether neural oscillatory dynamics predicted linguistic parsing when the acoustic properties of speech were maintained identically over time yet yielded different conscious percepts, a phenomenon known as "verbal transformations" (Basirat et al 2012;Billig et al 2013;Sato et al 2006Sato et al , 2007Warren 1968) (Fig. 1A).…”

mentioning

confidence: 99%

See 1 more Smart Citation

High-frequency neural activity predicts word parsing in ambiguous speech streams

Kösem

Basirat

Azizi

et al. 2016

Journal of Neurophysiology

Self Cite

View full text Add to dashboard Cite

Kösem A, Basirat A, Azizi L, van Wassenhove V. High-frequency neural activity predicts word parsing in ambiguous speech streams. J Neurophysiol 116: 2497-2512, 2016. First published September 7, 2016 doi:10.1152/jn.00074.2016.-During speech listening, the brain parses a continuous acoustic stream of information into computational units (e.g., syllables or words) necessary for speech comprehension. Recent neuroscientific hypotheses have proposed that neural oscillations contribute to speech parsing, but whether they do so on the basis of acoustic cues (bottom-up acoustic parsing) or as a function of available linguistic representations (top-down linguistic parsing) is unknown. In this magnetoencephalography study, we contrasted acoustic and linguistic parsing using bistable speech sequences. While listening to the speech sequences, participants were asked to maintain one of the two possible speech percepts through volitional control. We predicted that the tracking of speech dynamics by neural oscillations would not only follow the acoustic properties but also shift in time according to the participant's conscious speech percept. Our results show that the latency of high-frequency activity (specifically, beta and gamma bands) varied as a function of the perceptual report. In contrast, the phase of low-frequency oscillations was not strongly affected by top-down control. Whereas changes in low-frequency neural oscillations were compatible with the encoding of prelexical segmentation cues, high-frequency activity specifically informed on an individual's conscious speech percept.

show abstract

Visual contribution to the multistable perception of speech

Cited by 16 publications

References 38 publications

Parieto-frontal gamma band activity during the perceptual emergence of speech forms

Parieto-frontal gamma band activity during the perceptual emergence of speech forms

Multistability, cross-modal binding and the additivity of conjoined grouping principles

High-frequency neural activity predicts word parsing in ambiguous speech streams

Contact Info

Product

Resources

About