Real-Time Optical Motion Capture Balance Sonification System

Tillman, Mitchell; Dahl, Luke; Knowlton, Christopher; Zaferiou, Antonia M.

doi:10.1145/3401956.3404244

Cited by 2 publications

(1 citation statement)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several applications use sonification of biomechanical variables, whereby real-time biofeedback as to, for instance, the angle of a joint, is given through sound. Examples include sonified feedback for postural stabilization during challenged standing [ 42 ], knee-angle feedback during walking [ 43 ], gait improvement in Parkinson’s disease [ 44 ], and sensory substitution for visual impairment [ 45 , 46 ]. From the present results, we can add that sonifying movements not only holds promise as a form of real-time biofeedback, but also holds promise for investigating how multi-tasking affects the cognitive and motor resources needed for safe real-world mobility.…”

Section: Discussionmentioning

confidence: 99%

Concurrent Supra-Postural Auditory–Hand Coordination Task Affects Postural Control: Using Sonification to Explore Environmental Unpredictability in Factors Affecting Fall Risk

Dotov,

Motsenyat,

Trainor

2024

Sensors

View full text Add to dashboard Cite

Clinical screening tests for balance and mobility often fall short of predicting fall risk. Cognitive distractors and unpredictable external stimuli, common in busy natural environments, contribute to this risk, especially in older adults. Less is known about the effects of upper sensory–motor coordination, such as coordinating one’s hand with an external stimulus. We combined movement sonification and affordable inertial motion sensors to develop a task for the precise measurement and manipulation of full-body interaction with stimuli in the environment. In a double-task design, we studied how a supra-postural activity affected quiet stance. The supra-postural task consisted of rhythmic synchronization with a repetitive auditory stimulus. The stimulus was attentionally demanding because it was being modulated continuously. The participant’s hand movement was sonified in real time, and their goal was to synchronize their hand movement with the stimulus. In the unpredictable condition, the tempo changed at random points in the trial. A separate sensor recorded postural fluctuations. Young healthy adults were compared to older adult (OA) participants without known risk of falling. The results supported the hypothesis that supra-postural coordination would entrain postural control. The effect was stronger in OAs, supporting the idea that diminished reserve capacities reduce the ability to isolate postural control from sensory–motor and cognitive activity.

show abstract