Can simple error sonification in combination with music help improve accuracy in upper limb movements?

Dailly, Anabel Immoos; Sigrist, Roland; Kim, Yeongmi; Wolf, Peter; Erckens, Hendrik; Cerny, Joachim; Luft, Andreas R.; Gassert, Roger; Sulzer, James

doi:10.1109/biorob.2012.6290908

Cited by 6 publications

(4 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…External real-time auditory feedback has been extensively applied in upper-limb rehabilitation post-stroke (e.g., Maulucci and Eckhouse, 2001; Chen et al, 2006; Wallis et al, 2007; Dailly et al, 2012; Immoos et al, 2013; Bruckner et al, 2014; Fujii et al, 2016; reviewed in Ghai, 2018; see Supplementary Table 2 for details). For instance, Chen et al (2006) and Wallis et al (2007) tested a real-time multimodal sonification system which provided visual and auditory information in order to motivate arm reaching training for stroke patients.…”

Section: Resultsmentioning

confidence: 99%

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

et al. 2019

View full text Add to dashboard Cite

The role of auditory information on perceptual-motor processes has gained increased interest in sports and psychology research in recent years. Numerous neurobiological and behavioral studies have demonstrated the close interaction between auditory and motor areas of the brain, and the importance of auditory information for movement execution, control, and learning. In applied research, artificially produced acoustic information and real-time auditory information have been implemented in sports and rehabilitation to improve motor performance in athletes, healthy individuals, and patients affected by neurological or movement disorders. However, this research is scattered both across time and scientific disciplines. The aim of this paper is to provide an overview about the interaction between movement and sound and review the current literature regarding the effect of natural movement sounds, movement sonification, and rhythmic auditory information in sports and motor rehabilitation. The focus here is threefold: firstly, we provide an overview of empirical studies using natural movement sounds and movement sonification in sports. Secondly, we review recent clinical and applied studies using rhythmic auditory information and sonification in rehabilitation, addressing in particular studies on Parkinson’s disease and stroke. Thirdly, we summarize current evidence regarding the cognitive mechanisms and neural correlates underlying the processing of auditory information during movement execution and its mental representation. The current state of knowledge here reviewed provides evidence of the feasibility and effectiveness of the application of auditory information to improve movement execution, control, and (re)learning in sports and motor rehabilitation. Findings also corroborate the critical role of auditory information in auditory-motor coupling during motor (re)learning and performance, suggesting that this area of clinical and applied research has a large potential that is yet to be fully explored.

show abstract

Section: Resultsmentioning

confidence: 99%

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

et al. 2019

View full text Add to dashboard Cite

show abstract

“…Although this type of technology is considered the gold-standard of motion capture [41] the system comes at a high cost, and requires dedicated space, calibration time and trained personnel to maximize the capabilities of this technology. Examples of use in a rehabilitative context can be seen through: [42] [43], to capture reaching and grasping movements; [44] to capture the upper-body during rehabilitation exercises; [45] to capture hand movements during a figure tracing task. A LEAP motion controller was utilized by [46], and included in a system termed SonicHand by [47], to track hand and wrist movements.…”

Section: A Motion Capture Technologymentioning

confidence: 99%

“…Reference [20] linked position and velocity to trigger an audio sample. Reference [45] linked position to the addition of noise. References [55] and [56] linked position to melody, and loudness.…”

Section: B Sonification Mappingmentioning

confidence: 99%

A Mapping Review of Real-Time Movement Sonification Systems for Movement Rehabilitation

Nown

Upadhyay

Kerr

et al. 2023

IEEE Rev. Biomed. Eng.

View full text Add to dashboard Cite

Movement sonification is emerging as a useful tool for rehabilitation, with increasing evidence in support of its use. To create such a system requires component considerations outside of typical sonification design choices, such as the dimension of movement to sonify, section of anatomy to track, and methodology of motion capture. This review takes this emerging and highly diverse area of literature and keyword-code existing real-time movement sonification systems, to analyze and highlight current trends in these design choices, as such providing an overview of existing systems. A combination of snowballing through relevant existing reviews and a systematic search of multiple databases were utilized to obtain a list of projects for data extraction. The review categorizes systems into three sections: identifying the link between physical dimension to auditory dimension used in sonification, identifying the target anatomy tracked, identifying the movement tracking system used to monitor the target anatomy. The review proceeds to analyze the systematic mapping of the literature and provide results of the data analysis highlighting common and innovative design choices used, irrespective of application, before discussing the findings in the context of movement rehabilitation. A database containing the mapped keywords assigned to each project are submitted with this review.

show abstract

“…van Vugt & Tillmann (2015) found that participants engaged with error-based sonification improved motor regularity when performing tapping tasks. Dailly et al (2012) similarly reported that participants who were presented error-based sonification significantly reduced their spatial error completing a simple figure-tracing task. Wolf et al (2011) showed that novice participants were able to immediately use auditory feedback to enhance their rowing performance by reducing spatial and temporal errors during training.…”

Section: Introductionmentioning

confidence: 88%

Sonification of Golf Putting Gesture Reduces Swing Movement Variability in Novices

O’Brien

Juhas

Bieńkiewicz

et al. 2020

Research Quarterly for Exercise and Sport

View full text Add to dashboard Cite

This study investigates whether novices can use sonification to enhance golf putting performance and swing movements. Forty participants first performed a series of 2 m and 4 m putts, where swing velocities associated with successful trials were used to calculate their mean velocity profile (MVP). Participants were then divided into four groups with different auditory conditions: static pink noise unrelated to movement, auditory guidance based on personalized MVP, and two sonification strategies that mapped the real-time error between observed and MVP swings to modulate either the stereo display or roughness of the auditory guidance signal. Participants then performed a series of 2 m and 4 m putts with the auditory condition designated to their group. In general our results showed significant correlations between swing movement variability and putting performance for all sonification groups. More specifically, in comparison to the group exposed to static pink noise, participants who were presented auditory guidance significantly reduced the deviation from their average swing movement.In addition, participants exposed to error-based sonification with stereo display modulation significantly lowered their variability in timing swing movements.These results provide further evidence of the benefits of sonification for novices performing complex motor skill tasks. More importantly, our findings suggest participants were able to better use online error-based sonification rather than auditory guidance to reduce variability in the execution and timing of their movements.

show abstract

Can simple error sonification in combination with music help improve accuracy in upper limb movements?

Cited by 6 publications

References 18 publications

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

A Mapping Review of Real-Time Movement Sonification Systems for Movement Rehabilitation

Sonification of Golf Putting Gesture Reduces Swing Movement Variability in Novices

Contact Info

Product

Resources

About