Curve shape and curvature perception through interactive sonification

Alonso-Arévalo, Miguel A.; Shelley, Simon; Hermes, DJ Dik; Hollowood, Jacqueline; Pettitt, Michael; Sharples, Sarah; Kohlrausch, AG Armin

doi:10.1145/2355598.2355600

Cited by 17 publications

(12 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…instrumental sounds or richer synthesized sound). As certain works have highlighted, it is indeed possible to apply variations of a perceptual sound parameter to complex sound textures without affecting sonification performances [43]. Hence, a simple design process for the sonification of guidance tasks could be: define one or several targets according to the application; select a sonification strategy that corresponds to the required guidance (precision, rapidity or passing)…”

Section: Discussionmentioning

confidence: 99%

Comparison and Evaluation of Sonification Strategies for Guidance Tasks

Parseihian

Gondre

Aramaki

et al. 2016

IEEE Trans. Multimedia

View full text Add to dashboard Cite

International audienceThis article aims to reveal the efficiency of sonification strategies in terms of rapidity, precision and overshooting in the case of a one-dimensional guidance task. The sonification strategies are based on the four main perceptual attributes of a sound (i.e. pitch, loudness, duration/tempo and timbre) and classified with respect to the presence or not of one or several auditory references. Perceptual evaluations are used to display the strategies in a precision/rapidity space and enable prediction of user behavior for a chosen sonification strategy. The evaluation of sonification strategies constitutes a first step toward general guidelines for sound design in interactive multimedia systems that involve guidance issues

show abstract

Section: Discussionmentioning

confidence: 99%

Comparison and Evaluation of Sonification Strategies for Guidance Tasks

Parseihian

Gondre

Aramaki

et al. 2016

IEEE Trans. Multimedia

View full text Add to dashboard Cite

show abstract

“…After the participants had completed the evaluation assignments, they were asked to answer a questionnaire about their experience. Detailed information on the specific questions and answers and other human factor aspects of the evaluation can be found in [ 31 ]. In this article, we only wished to highlight that participants considered that sound helped them to understand the unseeable curvature information and to better examine the quality of the curve shape.…”

Section: Discussionmentioning

confidence: 99%

Force Sensitive Handles and Capacitive Touch Sensor for Driving a Flexible Haptic-Based Immersive System

Covarrubias

Bordegoni

Cugini

2013

Sensors

View full text Add to dashboard Cite

In this article, we present an approach that uses both two force sensitive handles (FSH) and a flexible capacitive touch sensor (FCTS) to drive a haptic-based immersive system. The immersive system has been developed as part of a multimodal interface for product design. The haptic interface consists of a strip that can be used by product designers to evaluate the quality of a 3D virtual shape by using touch, vision and hearing and, also, to interactively change the shape of the virtual object. Specifically, the user interacts with the FSH to move the virtual object and to appropriately position the haptic interface for retrieving the six degrees of freedom required for both manipulation and modification modalities. The FCTS allows the system to track the movement and position of the user's fingers on the strip, which is used for rendering visual and sound feedback. Two evaluation experiments are described, which involve both the evaluation and the modification of a 3D shape. Results show that the use of the haptic strip for the evaluation of aesthetic shapes is effective and supports product designers in the appreciation of the aesthetic qualities of the shape.

show abstract

“…The design of sonifications able to effectively communicate expressive qualities of movement-as a sort of "translation" from the visual to the auditory modality-is an interesting open research challenge that can have a wide number of applications in therapy and rehabilitation [6,33], sport [15,23] education [19] and human-machine interfaces [3].…”

Section: Related Workmentioning

confidence: 99%

Does embodied training improve the recognition of mid-level expressive movement qualities sonification?

Niewiadomski

Mancini

Cera

et al. 2018

J Multimodal User Interfaces

View full text Add to dashboard Cite

This research is a part of a broader project exploring how movement qualities can be recognized by means of the auditory channel: can we perceive an expressive full-body movement quality by means of its interactive sonification? The paper presents a sonification framework and an experiment to evaluate if embodied sonic training (i.e., experiencing interactive sonification of your own body movements) increases the recognition of such qualities through the auditory channel only, compared to a non-embodied sonic training condition. We focus on the sonification of two mid-level movement qualities: fragility and lightness. We base our sonification models, described in the first part, on the assumption that specific compounds of spectral features of a sound can contribute to the cross-modal perception of a specific movement quality. The experiment, described in the second part, involved 40 participants divided into two groups (embodied sonic training vs. no training). Participants were asked to report the level of lightness and fragility they perceived in 20 audio stimuli generated using the proposed sonification models. Results show that (1) both expressive qualities were correctly recognized from the audio stimuli, (2) a positive effect of embodied sonic training was observed for fragility but not for lightness. The paper is concluded by the description of the artistic performance that took place in 2017 in Genoa (Italy), in which the outcomes of the presented experiment were exploited. KeywordsSonification • Expressive qualities • Lightness • Fragility • Movement qualities • Embodied training M. Mancini participated to this work while being member of the Casa Paganini-

show abstract

Curve shape and curvature perception through interactive sonification

Cited by 17 publications

References 28 publications

Comparison and Evaluation of Sonification Strategies for Guidance Tasks

Comparison and Evaluation of Sonification Strategies for Guidance Tasks

Force Sensitive Handles and Capacitive Touch Sensor for Driving a Flexible Haptic-Based Immersive System

Does embodied training improve the recognition of mid-level expressive movement qualities sonification?

Contact Info

Product

Resources

About