Visual determinants of a cross-modal illusion

Armontrout, James A.; Schutz, Michael; Kubovy, Michael

doi:10.3758/app.71.7.1618

Cited by 14 publications

(11 citation statements)

References 60 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…14 The skeleton player showed the upper body of the marimbist, and included the performer's stroke preparation and release by showing that the illusion is driven primarily by the post-impact portion of the gesture. More specifically, it is driven by post-impact motion duration rather than post-impact velocity, acceleration, or distance (Armontrout et al 2009). …”

Section: The Discovery Of Privileged Bindingmentioning

confidence: 98%

Audio-Visual Objects

Kubovy

Schutz

2010

Rev.Phil.Psych.

View full text Add to dashboard Cite

In this paper we offer a theory of cross-modal objects. To begin, we discuss two kinds of linkages between vision and audition. The first is a duality. The the visual system detects and identifies surfaces; the auditory system detects and identifies sources. Surfaces are illuminated by sources of light; sound is reflected off surfaces. However, the visual system discounts sources and the auditory system discounts surfaces. These and similar considerations lead to the Theory of Indispensable Attributes that states the conditions for the formation of gestalts in the two modalities. The second linkage involves the formation of audiovisual objects, integrated cross-modal experiences. We describe research that reveals the role of cross-modal causality in the formation of such objects. These experiments use the canonical example of a causal link between vision and audition: a visible impact that causes a percussive sound.[A fire is] a terrestrial event with flames and fuel. It is a source of four kinds of stimulation, since it gives off sound, odor, heat and light . . . . One can hear it, smell it, feel it, and see it, or get any combination of these detections, and thereby perceive a fire . . . . For this event, the four kinds of stimulus information and the four perceptual systems are equivalent.

show abstract

Section: The Discovery Of Privileged Bindingmentioning

confidence: 98%

Audio-Visual Objects

Kubovy

Schutz

2010

Rev.Phil.Psych.

View full text Add to dashboard Cite

show abstract

“…In another experiment, Armontrout et al [20] replaced the video of the percussionist with an animation in which only a white disk on a black background was visible: the disk followed the path of the mallet head, and no impact surface was visible. Despite this extreme simplification, the results held.…”

Section: Bindingmentioning

confidence: 99%

Multistability, cross-modal binding and the additivity of conjoined grouping principles

Kubovy

2012

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

We present a sceptical view of multimodal multistability-drawing most of our examples from the relation between audition and vision. We begin by summarizing some of the principal ways in which audio-visual binding takes place. We review the evidence that unambiguous stimulation in one modality may affect the perception of a multistable stimulus in another modality. Crossmodal influences of one multistable stimulus on the multistability of another are different: they have occurred only in speech perception. We then argue that the strongest relation between perceptual organization in vision and perceptual organization in audition is likely to be by way of analogous Gestalt laws. We conclude with some general observations about multimodality.

show abstract

“…Videos of a renowned musician using long and short striking movements illustrate that vision can strongly affect judgments of musical note duration 16 . This illusion persists when using impact (but not sustained) sounds from other events 17 , point-light simplifications of the movements 18 , and even a single moving dot 19 . Curiously however, it breaks with widely-accepted thinking that vision exerts little influence on auditory judgments of event duration [20][21][22] .…”

Section: Amplitude Envelope's Crucial Role In Perceptual Organizationmentioning

confidence: 98%

On the generalization of tones: A detailed exploration of non-speech auditory perception stimuli

Schutz

Gillard

2020

Sci Rep

View full text Add to dashboard Cite

the dynamic changes in natural sounds' temporal structures convey important event-relevant information. However, prominent researchers have previously expressed concern that non-speech auditory perception research disproportionately uses simplistic stimuli lacking the temporal variation found in natural sounds. A growing body of work now demonstrates that some conclusions and models derived from experiments using simplistic tones fail to generalize, raising important questions about the types of stimuli used to assess the auditory system. To explore the issue empirically, we conducted a novel, large-scale survey of non-speech auditory perception research from four prominent journals. A detailed analysis of 1017 experiments from 443 articles reveals that 89% of stimuli employ amplitude envelopes lacking the dynamic variations characteristic of non-speech sounds heard outside the laboratory. Given differences in task outcomes and even the underlying perceptual strategies evoked by dynamic vs. invariant amplitude envelopes, this raises important questions of broad relevance to psychologists and neuroscientists alike. this lack of exploration of a property increasingly recognized as playing a crucial role in perception suggests future research using stimuli with time-varying amplitude envelopes holds significant potential for furthering our understanding of the auditory system's basic processing capabilities.

show abstract

Visual determinants of a cross-modal illusion

Cited by 14 publications

References 60 publications

Audio-Visual Objects

Audio-Visual Objects

Multistability, cross-modal binding and the additivity of conjoined grouping principles

On the generalization of tones: A detailed exploration of non-speech auditory perception stimuli

Contact Info

Product

Resources

About