Principles for Designing Body‐Centered Auditory Feedback

Tajadura‐Jiménez, Ana; Väljamäe, Aleksander; Bevilacqua, Frédéric; Bianchi-Berthouze, Nadia

doi:10.1002/9781118976005.ch18

Cited by 17 publications

(9 citation statements)

References 142 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Traditionally, different techniques have been developed with the aim of restoring walking ability, mainly from a compensatory perspective. 41,42 Over the past few years, new rehabilitation techniques relying on sensorimotor learning are being studied, as in the case of sound, 19,[43][44][45][46][47][48] offering a number of interesting advantages in the context of applications for movement rehabilitation, such as no interference with ongoing movement, provision of a continuous flow of information, 49 high temporal resolution, and high sensitivity for detecting structured motion. [50][51][52] Furthermore, pairing movements with sounds using instruments (music playing) and sonification of movements have been recently shown to be possible candidates for improvement of motor deficits in acute and chronic patients.…”

Section: Discussionmentioning

confidence: 99%

Enriching footsteps sounds in gait rehabilitation in chronic stroke patients: a pilot study

Gómez-Andrés

Grau-Sánchez

Duarte

et al. 2019

Annals of the New York Academy of Sciences

View full text Add to dashboard Cite

In the context of neurorehabilitation, sound is being increasingly applied for facilitating sensorimotor learning. In this study, we aimed to test the potential value of auditory stimulation for improving gait in chronic stroke patients by inducing alterations of the frequency spectra of walking sounds via a sound system that selectively amplifies and equalizes the signal in order to produce distorted auditory feedback. Twenty-two patients with lower extremity paresis were exposed to real-time alterations of their footstep sounds while walking. Changes in body perception, emotion, and gait were quantified. Our results suggest that by altering footsteps sounds, several gait parameters can be modified in terms of left-right foot asymmetry. We observed that augmenting low-frequency bands or amplifying the natural walking sounds led to a reduction in the asymmetry index of stance and stride times, whereas it inverted the asymmetry pattern in heel-ground exerted force. By contrast, augmenting high-frequency bands led to opposite results. These gait changes might be related to updating of internal forward models, signaling the need for adjustment of the motor system to reduce the perceived discrepancies between predicted-actual sensory feedbacks. Our findings may have the potential to enhance gait awareness in stroke patients and other clinical conditions, supporting gait rehabilitation.

show abstract

Section: Discussionmentioning

confidence: 99%

Enriching footsteps sounds in gait rehabilitation in chronic stroke patients: a pilot study

Gómez-Andrés

Grau-Sánchez

Duarte

et al. 2019

Annals of the New York Academy of Sciences

View full text Add to dashboard Cite

show abstract

“…The use of musical stimuli during exertion exercise has been shown to both lower people's perceived exertion and allow them to continue longer before exhaustion [8]. Moreover, movement-altering sonifications have explored a number of different sound types and their effect on both movement performance and bodily perception [9]. However, how these sonifications develop an expectation of movement which can then be manipulated through sound is yet to be investigated.…”

Section: Introductionmentioning

confidence: 99%

Movement sonification expectancy model: leveraging musical expectancy theory to create movement-altering sonifications

Newbold

Gold

Bianchi-Berthouze

2020

J Multimodal User Interfaces

Self Cite

View full text Add to dashboard Cite

When designing movement sonifications, their effect on people's movement must be considered. Recent work has shown how real-time sonification can be designed to alter the way people move. However, the mechanisms through which these sonifications alter people's expectations of their movement is not well explained. This is especially important when considering musical sonifications, to which people bring their own associations and musical expectation, and which can, in turn, alter their perception of the sonification. This paper presents a Movement Expectation Sonification Model, based on theories of motorfeedback and expectation, to explore how musical sonification can impact the way people perceive their movement. Secondly, we present a study that validates the predictions of this model by exploring how harmonic stability within sonification interacts with contextual cues in the environment to impact movement behaviour and perceptions. We show how musical expectancy can be built to either reward or encourage movement, and how such an effect is mediated through the presence of additional cues. This model offers a way for sonification designers to create movement sonifications that not only inform movement but can be used to encourage progress and reward successes.

show abstract

“…When feedback and predictions do not match, body-representations may be updated. Neuroscientific research has indeed shown that sensory feedback can be used to alter people's mental body-representations [2,14,19,27,28]. For example, observing a very long arm in VR can result in the illusion of owning that arm, if the arm moves in synchrony with one's actual arm [9].…”

Section: Using Sound In Response To Body Actions To Alter Mental Bodymentioning

confidence: 99%

“…Note that some of these mappings may not sound natural to users the first times. As discussed in [26][27][28], the mappings need to enhance the sense of agency so that the sound is perceived as directly produced by one's body action and potentially lead to body perception changes. Our next step is conducting user studies to clarify what mappings work best in terms of being perceived as directly created by one's body and what gesture-sound mappings are better associated by users to certain bodily sensations (e.g.…”

Section: System Overviewmentioning

confidence: 99%

“…Here, we present our novel approach through the framework of the MAGICSHOES project (www.magicshoes.es). We propose a rethink of PA technologies by embedding body-related factors in the design process [27], and exploit recent neuroscientific findings that body-perceptions can be changed via specially designed sensory feedback [2,14,19,28]. In the next sections, we provide the background that motivates/informs our work.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Designing a gesture-sound wearable system to motivate physical activity by altering body perception

Tajadura‐Jiménez

Cuadrado

Rick

et al. 2018

Proceedings of the 5th International Conference on Movement and Computing

Self Cite

View full text Add to dashboard Cite

People, through their bodily actions, engage in sensorimotor loops that connect them to the world and to their own bodies. People's brains integrate the incoming sensory information to form mental representations of their body appearance and capabilities. Technology provides exceptional opportunities to tweak sensorimotor loops and provide people with different experiences of their bodies. We recently showed that real-time sound feedback on one's movement (sonic avatar) can be

show abstract

Principles for Designing Body‐Centered Auditory Feedback

Cited by 17 publications

References 142 publications

Enriching footsteps sounds in gait rehabilitation in chronic stroke patients: a pilot study

Enriching footsteps sounds in gait rehabilitation in chronic stroke patients: a pilot study

Movement sonification expectancy model: leveraging musical expectancy theory to create movement-altering sonifications

Designing a gesture-sound wearable system to motivate physical activity by altering body perception

Contact Info

Product

Resources

About