Visual influences on auditory pluck and bow judgments

Saldaña, Helena M.; Rosenblum, Lawrence D.

doi:10.3758/bf03205276

Cited by 94 publications

(83 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…To ensure that they were attending to the visual information, as in previous studies they were also required to rate the degree to which the auditory and visual components of the stimulus agreed, using a second on-screen slider with endpoints labeled "Low agreement" and "High agreement." Rosenblum and colleagues (Rosenblum & Fowler, 1991;Saldaña & Rosenblum, 1993) have shown that this secondary task regarding audio-visual through each other. The presentation of a tone at the moment of overlap increased the likelihood that the event was perceived as a bounce.…”

Section: Methodsmentioning

confidence: 99%

Visual determinants of a cross-modal illusion

Armontrout

Schutz

Kubovy

2009

Attention, Perception & Psychophysics

View full text Add to dashboard Cite

Section: Methodsmentioning

confidence: 99%

Visual determinants of a cross-modal illusion

Armontrout

Schutz

Kubovy

2009

Attention, Perception & Psychophysics

View full text Add to dashboard Cite

“…2006), and cello sounds (Saldana and Rosenblum 1993). Moreover, click‐vowel Zulu syllables that are perceived by American English listeners as non‐speech (Best et al.…”

Section: Introductionmentioning

confidence: 99%

Spatio‐temporal distribution of brain activity associated with audio‐visually congruent and incongruent speech and the McGurk Effect

2015

View full text Add to dashboard Cite

IntroductionSpatio‐temporal distributions of cortical activity to audio‐visual presentations of meaningless vowel‐consonant‐vowels and the effects of audio‐visual congruence/incongruence, with emphasis on the McGurk effect, were studied. The McGurk effect occurs when a clearly audible syllable with one consonant, is presented simultaneously with a visual presentation of a face articulating a syllable with a different consonant and the resulting percept is a syllable with a consonant other than the auditorily presented one.MethodsTwenty subjects listened to pairs of audio‐visually congruent or incongruent utterances and indicated whether pair members were the same or not. Source current densities of event‐related potentials to the first utterance in the pair were estimated and effects of stimulus–response combinations, brain area, hemisphere, and clarity of visual articulation were assessed.ResultsAuditory cortex, superior parietal cortex, and middle temporal cortex were the most consistently involved areas across experimental conditions. Early (<200 msec) processing of the consonant was overall prominent in the left hemisphere, except right hemisphere prominence in superior parietal cortex and secondary visual cortex. Clarity of visual articulation impacted activity in secondary visual cortex and Wernicke's area. McGurk perception was associated with decreased activity in primary and secondary auditory cortices and Wernicke's area before 100 msec, increased activity around 100 msec which decreased again around 180 msec. Activity in Broca's area was unaffected by McGurk perception and was only increased to congruent audio‐visual stimuli 30–70 msec following consonant onset.ConclusionsThe results suggest left hemisphere prominence in the effects of stimulus and response conditions on eight brain areas involved in dynamically distributed parallel processing of audio‐visual integration. Initially (30–70 msec) subcortical contributions to auditory cortex, superior parietal cortex, and middle temporal cortex occur. During 100–140 msec, peristriate visual influences and Wernicke's area join in the processing. Resolution of incongruent audio‐visual inputs is then attempted, and if successful, McGurk perception occurs and cortical activity in left hemisphere further increases between 170 and 260 msec.

show abstract

“…Previous research has shown that this approach does not interfere with the primary task (Rosenblum & Fowler, 1991;Saldaña & Rosenblum, 1993). Because the purpose of these ratings was only to draw the participants' attention to the visual component of the stimulus, we did not analyze them.…”

Section: Participants and Proceduresmentioning

confidence: 99%

Causality and cross-modal integration.

Schutz

Kubovy

2009

Journal of Experimental Psychology: Human Perception and Perfor

View full text Add to dashboard Cite

Schutz and Lipscomb (2007) reported an audiovisual illusion in which the length of the gesture used to produce a sound altered the perception of that sound's duration. This contradicts the widely accepted claim that the auditory system generally dominates temporal tasks because of its superior temporal acuity. Here, in the first of 4 experiments, we show that impact gestures influence duration ratings of percussive but not sustained sounds. In the 2nd, we show that the illusion is present even if the percussive sound occurs up to 700 ms after the visible impact, but disappears if the percussive sound precedes the visible impact. In the 3rd experiment, we show that only the motion after the visible impact influences perceived tone duration. The 4th experiment (replacing the impact gestures with the written text long and short) suggests that the phenomenon is not due to response bias. Given that visual influence in this paradigm is dependent on the presence of an ecologically plausible audiovisual relationship, we conclude that cross-modal causality plays a key role in governing the integration of sensory information.

show abstract

Visual influences on auditory pluck and bow judgments

Cited by 94 publications

References 39 publications

Visual determinants of a cross-modal illusion

Visual determinants of a cross-modal illusion

Spatio‐temporal distribution of brain activity associated with audio‐visually congruent and incongruent speech and the McGurk Effect

Causality and cross-modal integration.

Contact Info

Product

Resources

About