Parchment-skin illusion: sound-biased touch

Jousmäki, Veikko; Hari, Riitta

doi:10.1016/s0960-9822(98)70120-4

Cited by 361 publications

(245 citation statements)

References 1 publication

Supporting

Mentioning

230

Contrasting

Unclassified

Order By: Relevance

“…The reported instances extend from somatosensory inputs to the cochlear nucleus through to bidirectional interactions between auditory and somatosensory cortex (16)(17)(18)(19)(20)(21)(22). There is also evidence that somatosensory inputs affect auditory perceptual function including cases involving speech (8,23,24).…”

Section: Discussionmentioning

confidence: 99%

Auditory plasticity and speech motor learning

Nasir

Ostry

2009

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Is plasticity in sensory and motor systems linked? Here, in the context of speech motor learning and perception, we test the idea sensory function is modified by motor learning and, in particular, that speech motor learning affects a speaker's auditory map. We assessed speech motor learning by using a robotic device that displaced the jaw and selectively altered somatosensory feedback during speech. We found that with practice speakers progressively corrected for the mechanical perturbation and after motor learning they also showed systematic changes in their perceptual classification of speech sounds. The perceptual shift was tied to motor learning. Individuals that displayed greater amounts of learning also showed greater perceptual change. Perceptual change was not observed in control subjects that produced the same movements, but in the absence of a force field, nor in subjects that experienced the force field but failed to adapt to the mechanical load. The perceptual effects observed here indicate the involvement of the somatosensory system in the neural processing of speech sounds and suggest that speech motor learning results in changes to auditory perceptual function.sensorimotor adaptation ͉ speech perception ͉ speech production A s a child learns to talk, or as an adult learns a new language, a growing mastery of oral fluency is matched by an increase in the ability to distinguish different speech sounds (1-5). Although these abilities may develop in isolation, it is also possible that speech motor learning alters a speaker's auditory map. This study offers a direct test of this hypothesis, that speech motor learning, and, in particular, somatosensory inputs associated with learning, affect the auditory classification of speech sounds (6-8). We assessed speech learning by using a robotic device that displaced the jaw and modified somatosensory input without altering speech acoustics (9-11). We found that even though auditory feedback was unchanged over the course of learning, subjects classify the same speech sounds differently after motor learning than before. Moreover, the perceptual shift was observed only in subjects that displayed motor learning. Subjects that failed to adapt to the mechanical load showed no perceptual shift even though they experienced the same force field as subjects that showed learning. Our findings are consistent with the idea that speech learning affects not only the motor system but also involves changes to sensory areas of the brain. ResultsTo explore the idea that speech motor learning affects auditory perception, we trained healthy adults in a force-field learning task (12, 13) in which a robotic device applied a mechanical load to the jaw as subjects repeated aloud test utterances that were chosen randomly from a set of four possibilities (bad, had, mad, sad) (Fig. 1). The test utterances were displayed on a computer monitor that was placed in front of the subjects. The mechanical load was velocity-dependent and acted to displace the jaw in a protrusion direction, al...

show abstract

Section: Discussionmentioning

confidence: 99%

Auditory plasticity and speech motor learning

Nasir

Ostry

2009

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

show abstract

“…However, somatosensory inputs may also affect auditory processing more directly. A number of studies have reported bidirectional effects linking somatosensory and auditory cortices (2)(3)(4)(5). Indeed, activity due to somatosensory inputs has been observed within a region of the human auditory cortex that is traditionally considered unisensory (3).…”

Section: Discussionmentioning

confidence: 99%

“…The present study indicates that there is also somatosensory involvement in the perception of speech. The existence of pathways between somatosensory and auditory areas of the brain has been documented previously (1)(2)(3)(4)(5). However, little is known about the possible role of somatosensory inputs, and in particular, those associated with speech production, in the perception of speech sounds.…”

mentioning

confidence: 95%

Somatosensory function in speech perception

Itō

Tiede

Ostry

2009

Proc. Natl. Acad. Sci. U.S.A.

166

184

View full text Add to dashboard Cite

Somatosensory signals from the facial skin and muscles of the vocal tract provide a rich source of sensory input in speech production. We show here that the somatosensory system is also involved in the perception of speech. We use a robotic device to create patterns of facial skin deformation that would normally accompany speech production. We find that when we stretch the facial skin while people listen to words, it alters the sounds they hear. The systematic perceptual variation we observe in conjunction with speech-like patterns of skin stretch indicates that somatosensory inputs affect the neural processing of speech sounds and shows the involvement of the somatosensory system in the perceptual processing in speech.multisensory integration ͉ speech production

show abstract

“…Research on intersensory interactions of haptic inputs with other modalities has predominately focused on how vision is combined with touch, although haptic/ auditory interactions have also been studied (e.g., Jousmäki & Hari, 1998;Rock & Victor, 1964;Spence, Nicholls, & Driver, 2001). In keeping with modality specializations outlined above, the relative weighting of vision in relation to touch is greater when geometric properties are being judged than when material properties are tested.…”

Section: Other Significant Issues Vision-touch Interactionsmentioning

confidence: 99%