Listening Touch

Giomi, Andrea; Fratagnoli, Federica

doi:10.1145/3212721.3212815

Cited by 5 publications

(2 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Likewise, orientation is a preferred physical dimension, and is used most in combination with the following auditory categories: timbral as demonstrated by [127], [33], [128]; pitch as demonstrated by [85], [30], [129], [130]; spatial as demonstrated by [131]- [133]. Finally, acceleration is generally chosen in combination with the following auditory categories: loudness as demonstrated by [134], [135]; timbral as demonstrated by [136]- [141]; pitch as demonstrated by [142]- [144]. Outside of the PVAO physical dimensions, data obtained as force or pressure, as dictated by the use of a force or pressure sensor, has been combined with sampled sounds [145], and changes in loudness [84], timbral [32], pitch [69] and, temporal-related [71] auditory feedback.…”

Section: B Sonification Mappingmentioning

confidence: 99%

A Mapping Review of Real-Time Movement Sonification Systems for Movement Rehabilitation

Nown

Upadhyay

Kerr

et al. 2023

IEEE Rev. Biomed. Eng.

View full text Add to dashboard Cite

Movement sonification is emerging as a useful tool for rehabilitation, with increasing evidence in support of its use. To create such a system requires component considerations outside of typical sonification design choices, such as the dimension of movement to sonify, section of anatomy to track, and methodology of motion capture. This review takes this emerging and highly diverse area of literature and keyword-code existing real-time movement sonification systems, to analyze and highlight current trends in these design choices, as such providing an overview of existing systems. A combination of snowballing through relevant existing reviews and a systematic search of multiple databases were utilized to obtain a list of projects for data extraction. The review categorizes systems into three sections: identifying the link between physical dimension to auditory dimension used in sonification, identifying the target anatomy tracked, identifying the movement tracking system used to monitor the target anatomy. The review proceeds to analyze the systematic mapping of the literature and provide results of the data analysis highlighting common and innovative design choices used, irrespective of application, before discussing the findings in the context of movement rehabilitation. A database containing the mapped keywords assigned to each project are submitted with this review.

show abstract

Section: B Sonification Mappingmentioning

confidence: 99%

A Mapping Review of Real-Time Movement Sonification Systems for Movement Rehabilitation

Nown

Upadhyay

Kerr

et al. 2023

IEEE Rev. Biomed. Eng.

View full text Add to dashboard Cite

show abstract

“…Rheden et al [51] contributed a literature review of sonification approaches for HCI in sports, analyzing the use cases and implementations of auditory solutions during physical exertion. They reported that auditory feedback was successfully used in running [27], swimming [42], dance [14] and cycling [43]. Further, sound was used in combination with other feedback modalities.…”

Section: Feedback In Hci For Sportsmentioning

confidence: 99%

MTBalance

Berentsen

Bentvelzen

Woźniak

2021

Proc. ACM Hum.-Comput. Interact.

View full text Add to dashboard Cite

Mountain Biking (MTB) is an increasingly popular outdoors activity which offers a unqiue connection to nature along with the health benefits of cardiovascular exercise. Yet, complex MTB technique is an entry barrier that often prevent novices from enjoying the sport. Developing interactive systems, which can support developing MTB proficiency can augment the outdoor experience and make the sport available to a larger group of users. To that end, we designed, implemented and evaluate MTBalance - a system which provides body posture feedback for beginner mountain bikers. Based on inertial tracking, MTBalance informs the user about how to correct their posture to improve MTB performance. We conducted a study in which we compared different feedback modalities for MTBalance. We observed that the system increased perceived balance awareness. Our work provides insights for designing body awareness systems for outdoor sports.

show abstract

Beginnings and endings—dance phrase edges in an interactive dance study

Bergsland

2024

Pers Ubiquit Comput

View full text Add to dashboard Cite

This article describes a study exploring the expressive and creative potential of dance phrase onsets and endings in interactive dance, using an artistic research approach. After describing the context and background of interactive dance and relevant perceptual issues, the technical setup is presented, both in terms of the performance area, sensors and other hardware, and software. The main part of the article is concerned with the specific movement-sound mappings and their relation to the dancer’s movement choices in four different sections in the performance that the project resulted in, entitled Beginnings and Endings - Study I. Subsequently, the process and performance are evaluated, specifically focusing on the performer’s perspective. The most interesting points from the evaluation are then discussed with reference to the presented mappings, related movement choices, and relevant research literature. Findings include that the dancer experienced an increased awareness of beginnings and endings in different sections of the performance, that the affordances of different mappings were explored in different ways and to different degrees, and that some of this could be ascribed to a dynamic between liberation and restriction.

show abstract

Listening Touch

Cited by 5 publications

References 32 publications

A Mapping Review of Real-Time Movement Sonification Systems for Movement Rehabilitation

A Mapping Review of Real-Time Movement Sonification Systems for Movement Rehabilitation

MTBalance

Beginnings and endings—dance phrase edges in an interactive dance study

Contact Info

Product

Resources

About