Visual sensitivity is a stronger determinant of illusory processes than auditory cue parameters in the sound-induced flash illusion

Kumpik, Daniel P.; Roberts, Helen; King, Andrew J.; Bizley, Jennifer K.

doi:10.1167/14.7.12

Cited by 28 publications

(34 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our subjects generally weighted ILS higher than ITDs, which is consistent with a previous observation that the former may be more salient when binaural cues are presented over headphones in multisensory experiments (Kumpik et al, 2014). This is likely to be because our stimuli were bandpass filtered from 0.5-16 kHz, which would have removed some of the fine-structure ITD information from the HRTF and thus made the ITD less salient than might otherwise be expected (Wightman and Kistler, 1992).…”

Section: Discussionsupporting

confidence: 92%

Re-weighting of Sound Localization Cues by Audiovisual Training

Kumpik

Campbell

Schnupp

et al. 2019

Preprint

View full text Add to dashboard Cite

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest Author contribution statement DK, JS and AK conceived and designed the study; DK and CC carried out the experiments and analyzed the data; DK, JS and AK wrote the manuscript. Abstract Word count: 350Sound localization requires the integration in the brain of auditory spatial cues generated by interactions with the external ears, head and body. Perceptual learning studies have shown that the relative weighting of these cues can change in a contextdependent fashion if their relative reliability is altered. One factor that may influence this process is vision, which tends to dominate localization judgments when both modalities are present and induces a recalibration of auditory space if they become misaligned. It is not known, however, whether vision can alter the weighting of individual auditory localization cues. Using non-individualized head-related transfer functions, we measured changes in subjects' sound localization biases and binaural localization cue weights after ~55 minutes of training on an audiovisual spatial oddball task. Four different configurations of spatial congruence between visual and auditory cues (interaural time differences (ITDs) and frequency-dependent interaural level differences (interaural level spectra, ILS) were used. When visual cues were spatially congruent with both auditory spatial cues, we observed an improvement in sound localization, as shown by a reduction in the variance of subjects' localization biases, which was accompanied by an up-weighting of the more salient ILS cue. However, if the position of either one of the auditory cues was randomized during training, no overall improvement in sound localization occurred. Nevertheless, the spatial gain of whichever cue was matched with vision increased, with different effects observed on the gain for the randomized cue depending on whether ITDs or ILS were matched with vision. As a result, we observed a similar up-weighting in ILS when this cue alone was matched with vision, but no overall change in binaural cue weighting when ITDs corresponded to the visual cues and ILS were randomized. Consistently misaligning both cues with vision produced the ventriloquism aftereffect, i.e., a corresponding shift in auditory localization bias, without affecting the variability of the subjects' sound localization judgments, and no overall change in binaural cue weighting. These data show that visual contextual information can invoke a reweighting of auditory localization cues, although concomitant improvements in sound localization are only likely to accompany training with fully congruent audiovisual information. Contribution to the fieldFor the brain to construct a single unified percept of the world, it is necessary that information from our different senses is combined and integrated. This is often thought to be achieved in a statistically optimal fashion with different se...

show abstract

Section: Discussionsupporting

confidence: 92%

Re-weighting of Sound Localization Cues by Audiovisual Training

Kumpik

Campbell

Schnupp

et al. 2019

Preprint

View full text Add to dashboard Cite

show abstract

“…Furthermore, some studies have shown that under certain conditions, inferences regarding the perceptual nature of the illusory flash can be made (McCormick and Mamassian, 2008). Such studies have suggested that a higher SiFI effect corresponds to a lower sensitivity; the lower perceptual sensitivity, calculated by d' , can be considered a measure of susceptibility to the illusion (McCormick and Mamassian, 2008;Kumpik et al, 2014). In the present study, the RS of auditory stimuli decreased the perceptual sensitivity of auditory stimuli, which resulting in lower auditory dominance.…”

Section: The Effects Of Repetition Suppression On Sifisupporting

confidence: 44%

“…A lower perceptual sensitivity could be the cause of a higher SiFI and could therefore be a measure of susceptibility to the illusions (McCormick and Mamassian, 2008;Kumpik et al, 2014). This, together with the RS, could influence the intensity of neural activity in the perceptual sensitivity to the stimuli (Grill-Spector and Malach, 2001).…”

Section: Discussionmentioning

confidence: 99%

“…Some studies have also suggested that a higher SiFI corresponds to lower sensitivity; a lower perceptual sensitivity, calculated by d', can indicate susceptibility to the illusion (McCormick and Mamassian, 2008;Kumpik et al, 2014). Repetition suppression (RS) is known to influence perceptual sensitivity (Sobotka and Ringo, 1994;Grill-Spector and Malach, 2001); that is, when the same visual stimuli are repeated, the participants had a faster response to the stimuli and a lower error rate (Ferrand and Grainger, 1992;Schacter and Buckner, 1998;James et al, 1999James et al, , 2000Henson, 2003), and the amplitude of neural activity in the cortex induced by this stimulus decreased significantly following presentation of the repeated stimuli (Grill-Spector et al, 1998.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Effects of Repetition Suppression on Sound Induced Flash Illusion With Aging

Sun

Liu

et al. 2020

Front. Psychol.

View full text Add to dashboard Cite

The sound-induced flash illusion (SiFI) is a classical auditory-dominated multisensory integration phenomenon in which the observer misperceives the number of visual flashes due to the simultaneous presentation of a different number of auditory beeps. Although the SiFI has been documented to correlate with perceptual sensitivity, to date there is no consensus as to how it corresponds to sensitivity with aging. The present study was based on the SiFI paradigm (Shams et al., 2000), adding repeated auditory stimuli prior to the appearance of audiovisual stimuli to investigate the effects of repetition suppression (RS) on the SiFI with aging. The repeated auditory stimuli consisted of one or two of the same auditory stimuli presented twice in succession, which were then followed by the audiovisual stimuli. By comparing the illusions in old and young adults, we aimed to explore the influence of aging on the RS of auditory stimuli on the SiFI. The results showed that both age groups showed SiFI effects, however, the RS performance of the two age groups had different effects on the fusion and fission illusions. The illusion effect in old adults was weaker than in young adults. Specifically, RS only affected fission illusions in the old adults but both fission and fusion illusions in young adults. Thus, the present study indicated that the decreased perceptual sensitivity based on auditory RS could weaken the SiFI effect in multisensory integration and that old adults are more susceptible to RS, showing that old adults perceived the SiFI effect weakly under auditory RS.

show abstract

“…The SIFI is an illusion in which brief visual and auditory stimuli are presented rapidly, and the number of auditory stimuli influences the reported number of visual stimuli. Signal-detection theory analysis has demonstrated that illusory flashes are accompanied by measured changes in sensitivity (and not only bias) 26 , 27 , suggesting that this illusion is due in part to a change in perception. However, illusory flashes are not perceived in the same way as real flashes: when offered a third ‘not-one, not-two’ option many subjects choose it [28] .…”

Section: Section I Behavioral Assaysmentioning

confidence: 99%

Defining Auditory-Visual Objects: Behavioral Tests and Physiological Mechanisms

Bizley

Maddox

Lee

2016

Trends in Neurosciences

View full text Add to dashboard Cite

Crossmodal integration is a term applicable to many phenomena in which one sensory modality influences task performance or perception in another sensory modality. We distinguish the term binding as one that should be reserved specifically for the process that underpins perceptual object formation. To unambiguously differentiate binding form other types of integration, behavioral and neural studies must investigate perception of a feature orthogonal to the features that link the auditory and visual stimuli. We argue that supporting true perceptual binding (as opposed to other processes such as decision-making) is one role for cross-sensory influences in early sensory cortex. These early multisensory interactions may therefore form a physiological substrate for the bottom-up grouping of auditory and visual stimuli into auditory-visual (AV) objects.

show abstract

Visual sensitivity is a stronger determinant of illusory processes than auditory cue parameters in the sound-induced flash illusion

Cited by 28 publications

References 38 publications

Re-weighting of Sound Localization Cues by Audiovisual Training

Re-weighting of Sound Localization Cues by Audiovisual Training

Effects of Repetition Suppression on Sound Induced Flash Illusion With Aging

Defining Auditory-Visual Objects: Behavioral Tests and Physiological Mechanisms

Contact Info

Product

Resources

About