Crossmodal Modulation of Spatial Localization by Mimetic Words

Abstract

The present study investigated whether aurally presented mimetic words affect the judgment of the final position of a moving object. In Experiment 1, horizontal apparent motion of a visual target was presented, and an auditory mimetic word of “byun” (representing rapid forward motion), “pitari” (representing stop of motion), or “nisahi” (nonsense syllable) was presented via headphones. Observers were asked to judge which of two test stimuli was horizontally aligned with the target. The results showed that forward displacement in the “pitari” condition was significantly smaller than in the “byun” and “nisahi” conditions. However, when non-mimetic but meaningful words were presented (Experiment 2), this effect did not occur. Our findings suggest that the mimetic words, especially that meaning stop of motion, affect spatial localization by means of mental imagery regarding “stop” established by the phonological information of the word.

Correspondence Between Cognitive and Audiological Evaluations Among the Elderly: A Preliminary Report of an Audiological Screening Model of Subjects at Risk of Cognitive Decline With Slight to Moderate Hearing Loss

“…Older individuals with CAPD seem to be more likely to suffer from dementia than those who are not affected (Martini et al, 2014;Fortunato et al, 2016). The decline can be highlighted in circumstances requiring greater cognitive effort and stressful conditions, such as speech discrimination of words or logatomes in noise or in quiet (Martini et al, 1988;Strauss et al, 2015;Gobara et al, 2016;Taitelbaum-Swead and Fostick, 2016;Bae et al, 2018). Competitive stimuli should be the most sensitive for detecting cognitive efforts or difficulties among elderly people (Pronk et al, 2013).…”

Semiotic mode and sensory modality in multimodal semiotics: Recognizing difference and building complementarity between the terms

“…The discussion of crossmodal modulation (see e.g. Driver, Spence 2000;Nuku, Bekkering 2010;Gobara, Yamada, Miura 2016) may also shed light on the dominance and hierarchy between modalities. For quite a long time, visual processing was treated as independent of other modalities, often as the most prominent one.…”