On the interplay of visuospatial and audiotemporal dominance: Evidence from a multimodal kappa effect

Bausenhart, Karin M.; Quinn, Katrina

doi:10.3758/s13414-017-1437-z

Cited by 6 publications

(5 citation statements)

References 70 publications

(125 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To fully understand human processing of time and space, multisensory studies are needed. It was already shown that cross-modality tau (Kawabe et al, 2008 ) and kappa (Bausenhart & Quinn, 2018 ) effects can be observed when temporal information is presented auditorily and spatial information visually. Also, research in related areas, for instance, on the representational momentum (the final location of a disappearing moving object is perceived to be shifted in motion direction), indicates cross-modality effects from visually presented motion on tactile localization but not vice versa (Merz et al, 2020 ).…”

Section: Discussionmentioning

confidence: 98%

Tau and kappa in interception – how perceptual spatiotemporal interrelations affect movements

Schroeger

Raab

Cañal‐Bruland

2022

Atten Percept Psychophys

View full text Add to dashboard Cite

Batting and catching are real-life examples of interception. Due to latencies between the processing of sensory input and the corresponding motor response, successful interception requires accurate spatiotemporal prediction. However, spatiotemporal predictions can be subject to bias. For instance, the more spatially distant two sequentially presented objects are, the longer the interval between their presentations is perceived (kappa effect) and vice versa (tau effect). In this study, we deployed these phenomena to test in two sensory modalities whether temporal representations depend asymmetrically on spatial representations, or whether both are symmetrically interrelated. We adapted the tau and kappa paradigms to an interception task by presenting four stimuli (visually or auditorily) one after another on four locations, from left to right, with constant spatial and temporal intervals in between. In two experiments, participants were asked to touch the screen where and when they predicted a fifth stimulus to appear. In Exp. 2, additional predictive gaze measures were examined. Across experiments, auditory but not visual stimuli produced a tau effect for interception, supporting the idea that the relationship between space and time is moderated by the sensory modality. Results did not reveal classical auditory or visual kappa effects and no visual tau effects. Gaze data in Exp. 2 showed that the (spatial) gaze orientation depended on temporal intervals while the timing of fixations was modulated by spatial intervals, thereby indicating tau and kappa effects across modalities. Together, the results suggest that sensory modality plays an important role in spatiotemporal predictions in interception.

show abstract

Section: Discussionmentioning

confidence: 98%

Tau and kappa in interception – how perceptual spatiotemporal interrelations affect movements

Schroeger

Raab

Cañal‐Bruland

2022

Atten Percept Psychophys

View full text Add to dashboard Cite

show abstract

“…Compared to the previous studies on multimodal stimulation [25], [11], [12], each assessing only a specific incongruent condition, this study provides a wide overview, although on a preliminary base, of all the possible reciprocal influences between visual and tactile domains concerning time and space perception. This overview shows a general preeminent role of the visual domain on the tactile one, specially when they conflict [34]: in particular, regarding the time perception, the Kappa effect vanished in both the perceptual channels when the temporal illusion was provided in the tactile domain only (i.e., BIT).…”

Section: Discussionmentioning

confidence: 99%

“…Russo and Dell'Antonio [12], instead, were able to reproduce the tactile Tau effect exploiting the auditory Oppel-Kundt temporal illusion (i.e., a subdivided time interval is perceived longer than a non subdivided one), confirming that also an apparent temporal dilation can alter the perception of physical spaces. Finally, despite the usual prevalence of the auditory domain in the perception of time, Bausenhart et al [25] found a significant Kappa effect originated by a task-irrelevant visual stimulus on the estimation of auditory intervals duration.…”

Section: A Related Workmentioning

confidence: 94%

“…All the above-mentioned studies mainly investigated the effects played by an orthogonal stimulation on one channel to another perceptual channel, thus not providing information relevant to the dimension where the illusory effect is observed [25], [11]. By contrast, our research makes use of more ecological convergent visuo-tactile stimulation, providing redundant information across different perceptual domains on the independent variable, either space or time, that actually determine the illusory effect on the other dependent variable, either time or space.…”

Section: A Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Toward the manipulation of time and space in extended reality: a preliminary study on multimodal Tau and Kappa illusions in the visual-tactile domain

Pra

Catrambone

Wassenhove

et al. 2022

2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)

View full text Add to dashboard Cite

In the last few years, Extended reality (XR) has enabled novel forms of sensory experiences and social interplay, which can be hardly experienced in real life. However, the full potential of XR has not been exploited yet, since vision remains the main interaction modality, and the time-and spacemodulation of the sense of self -which could open interesting perspectives in several scenarios -is still largely unexplored. To pave the path to a multi-modal manipulation of the sense of time and space in immersive XR, in this work we discuss the preliminary outcomes of the first investigation in the visualtactile domain of two well known perceptual illusions affecting spatial and temporal perception, i.e. Tau and Kappa effects, respectively. We compared the effects originated from unimodal stimulation (i.e., only visual or tactile) with the same effects induced by convergent bimodal stimulation (i.e., visual and tactile), delivered to the forearm. Results show that both Tau and Kappa effects are affected by the multi-modality of the stimulation, and that the perceptual bias differently affects time-or space-perception based on the modality used for stimulus delivery. Our results, although preliminary, seem to suggest that multimodal perceptual illusions could be a viable solution for time-and space-modulation of the sense of self in immersive XR and advanced social human-robot interaction.

show abstract

“…The Kappa effect elicited by the multiple modalities has received scarce attention. Bausenhart et al 14 found a significant Kappa effect originated by a visual stimulus on the estimation of auditory interval duration. The same authors were able to generate a time dilation by modulating the asynchrony between visual and auditory stimuli 15 .…”

Section: Introductionmentioning

confidence: 99%

When space rules time: the Kappa effect with concurrent visual and tactile stimulation

Pra

Catrambone

Wassenhove

et al. 2023

Preprint

View full text Add to dashboard Cite

The spatial and temporal dimensions of a subjective experience are intertwined. In the Kappa effect, the spatial distance between consecutive visual stimuli proportionally influences the perceived duration of the inter-stimulus interval. Despite its relevance, to our knowledge no study has investigated such an illusory effect in concurrent multimodal perception through visual and tactile elicitations. To overcome this limitation, we characterise the Kappa effect on vision and somatosensation also through the assessment of duration perception in the sub-second range when sensory inputs are delivered on the palm or forearm using wearable devices. The effect of unimodal visual/tactile elicitations was also compared to several bimodal stimulations. Results showed that the illusory effect, which arose in both unimodal conditions, produces significantly higher distortions in vision. In the multimodal condition, when visual stimuli were at not-equidistant spatial locations, the integration with the tactile channel did not diminish the Kappa effect. Conversely, the Kappa effect vanished when the visual stimuli were at equidistant spatial locations, independently from the tactile stimuli location. These findings shed light on the human perceptual mechanisms, suggesting that the perceptual channel with lower variance in the spatial discrimination has a preeminent role in determining illusory perceptions in the time domain.

show abstract

On the interplay of visuospatial and audiotemporal dominance: Evidence from a multimodal kappa effect

Cited by 6 publications

References 70 publications

Tau and kappa in interception – how perceptual spatiotemporal interrelations affect movements

Tau and kappa in interception – how perceptual spatiotemporal interrelations affect movements

Toward the manipulation of time and space in extended reality: a preliminary study on multimodal Tau and Kappa illusions in the visual-tactile domain

When space rules time: the Kappa effect with concurrent visual and tactile stimulation

Contact Info

Product

Resources

About