Haptics in Music: The Effects of Vibrotactile Stimulus in Low Frequency Auditory Difference Detection Tasks

Young, Gareth W.; Murphy, David; Weeter, Jeffrey

doi:10.1109/toh.2016.2646370

Cited by 20 publications

(11 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The vibrating glove was a replication of the glove used by Young et al (2017) and was equipped with six independent audio-haptic voice-coil exciters. The voice-coil transducers (TEAX14C02-8 Compact Audio Exciter) had a diameter of 14 mm and were designed to deliver vibrotactile output.…”

Section: Methodsmentioning

confidence: 99%

“…To examine whether such discrimination enhancements extended to multisensory processing, Young et al (2017) used a two-alternative forced choice task in which participants had to determine whether a pair of stimuli were the same or different. Participant could hear the stimuli, combined or not with a corresponding tactile stimulation transmitted through a glove.…”

Section: Introductionmentioning

confidence: 99%

“…The present study aims at investigating the auditory, tactile and audiotactile identification of various emotions in musicians using the stimuli of Vieillard et al (2008) and tactile stimulation technology developed by Young et al (2017). This study will be the first to examine tactile and auditory-tactile identification of emotion abilities in musicians versus controls.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Musicians Show Better Auditory and Tactile Identification of Emotions in Music

et al. 2019

View full text Add to dashboard Cite

Musicians are better at processing sensory information and at integrating multisensory information in detection and discrimination tasks, but whether these enhanced abilities extend to more complex processes is still unknown. Emotional appeal is a crucial part of musical experience, but whether musicians can better identify emotions in music throughout different sensory modalities has yet to be determined. The goal of the present study was to investigate the auditory, tactile and audiotactile identification of emotions in musicians. Melodies expressing happiness, sadness, fear/threat, and peacefulness were played and participants had to rate each excerpt on a 10-point scale for each of the four emotions. Stimuli were presented through headphones and/or a glove with haptic audio exciters. The data suggest that musicians and control are comparable in the identification of the most basic (happiness and sadness) emotions. However, in the most difficult unisensory identification conditions (fear/threat and peacefulness), significant differences emerge between groups, suggesting that musical training enhances the identification of emotions, in both the auditory and tactile domains. These results support the hypothesis that musical training has an impact at all hierarchical levels of sensory and cognitive processing.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Musicians Show Better Auditory and Tactile Identification of Emotions in Music

et al. 2019

View full text Add to dashboard Cite

show abstract

“…50Hz to 700Hz). Therefore, vibrotactile and auditory information can be naturally perceived as an interleaved signal, which is then also processed in partially shared brain regions, in both hearing participants as well as in congenitally deaf [29,30,31,32,33,34,35].…”

Section: Introductionmentioning

confidence: 99%

Speech-to-touch sensory substitution: a 10-decibel improvement in speech-in-noise understanding after a short training

Cieśla

Wolak

Lorens

et al. 2021

Preprint

View full text Add to dashboard Cite

Understanding speech in background noise is challenging. Wearing face-masks during COVID19-pandemics made it even harder. We developed a multi-sensory setup, including a sensory substitution device (SSD) that can deliver speech simultaneously through audition and as vibrations on fingertips. After a short training session, participants significantly improved (16 out of 17) in speech-in-noise understanding, when added vibrations corresponded to low-frequencies extracted from the sentence. The level of understanding was maintained after training, when the loudness of the background noise doubled (mean group improvement of ~ 10 decibels). This result indicates that our solution can be very useful for the hearing-impaired patients. Even more interestingly, the improvement was transferred to a post-training situation when the touch input was removed, showing that we can apply the setup for auditory rehabilitation in cochlear implant-users. Future wearable implementations of our SSD can also be used in real-life situations, when talking on the phone or learning a foreign language. We discuss the basic science implications of our findings, such as we show that even in adulthood a new pairing can be established between a neuronal computation (speech processing) and an atypical sensory modality (tactile). Speech is indeed a multisensory signal, but learned from birth in an audio-visual context. Interestingly, adding lip reading cues to speech in noise provides benefit of the same or lower magnitude as we report here for adding touch.

show abstract

“…JND studies have found applications in various areas of psychophysics including sound perception such as music and speech [27], visual perception [2,11], and haptics [8,12,27]. In this work, we narrow the focus of our attention to visual perception, specifically the perception of image quality.…”

Section: Introductionmentioning

confidence: 99%

Interpreting MOS scores, when can users see a difference? Understanding user experience differences for photo quality

et al. 2018

View full text Add to dashboard Cite

The use of no-reference image quality evaluation tools that produce MOS scores, like the VIQET tool which was released by the Video Quality Expert Group, raises the question of whether the produced MOS differences between images correspond to noticeable differences in quality by the consumers. In this work, we attempted to approximate the minimum MOS difference that is required in order for people to be able to distinguish between a higher and a lower quality image under realistic conditions that are commonly encountered in the current consumer space. 91 people participated in a subjective justnoticeable-differences study across three countries that used non-simulated image stimuli, produced and evaluated through crowd sourcing for the validation of the VIQET no-reference image quality tool. The image dataset consisted of 15 different scenes belonging to three different scene types, with a total of 210 different image pairs being used. After evaluating the quality of the collected data, a logistic regression analysis approach was employed in order to estimate the minimum MOS difference required between two images in order for a given percentage of people to be able to detect the higher quality image.

show abstract

Haptics in Music: The Effects of Vibrotactile Stimulus in Low Frequency Auditory Difference Detection Tasks

Cited by 20 publications

References 26 publications

Musicians Show Better Auditory and Tactile Identification of Emotions in Music

Musicians Show Better Auditory and Tactile Identification of Emotions in Music

Speech-to-touch sensory substitution: a 10-decibel improvement in speech-in-noise understanding after a short training

Interpreting MOS scores, when can users see a difference? Understanding user experience differences for photo quality

Contact Info

Product

Resources

About