Design and Evaluation of a Multisensory Concert for Cochlear Implant Users

Abstract

This article describes the design, implementation, and evaluation of vibrotactile concert furniture, aiming to improve the live music experience of people with hearing loss using hearing technology such as cochlear implants (CI). The system was the result of a series of participatory design sessions involving CI users with different hearing assistive setups (bi-implant, bimodal, and monoimplant), and it was evaluated in a concert scenario (drums, bass, and female vocals) at the Royal Danish Academy of Music. The project aimed to improve the music appreciation for CI users by providing a multisensory concert designed with CI challenges in mind, but not excluding normal-hearing individuals or individuals with other forms of hearing aids from participating in the event. The evaluation was based on (video-recorded) observations and postexperience semistructured interviews; the data were analyzed using event analysis and meaning condensation. The results indicate that tactile augmentation provides a pleasant experience for CI users. However, concertgoers with residual hearing reported being overwhelmed if the tactile stimulation amplitude exceeds a certain threshold. Furthermore, devices that highlight instrument segregation are preferred over ones that present a tactile mixdown of multiple auditory streams.

Vibrotactile enhancement of musical engagement

“…Music can be heard through the ears and felt through the body via acoustic and vibrotactile sensory receptors, respectively. A variety of approaches for the vibrotactile enhancement of musical experience have been researched in recent years [1][2][3][4] , see Paisa et al for a review 5 . Despite these advances, rigorous evaluations of the effects of vibrotactile stimulation on music perception are still scarce.…”