Exploring Sound-Motion Similarity in Musical Experience

Godøy, Rolf Inge; Song, Min‐Ho; Nymoen, Kristian; Haugen, Mari Romarheim; Jensenius, Alexander Refsum

doi:10.1080/09298215.2016.1184689

Cited by 25 publications

(20 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Automatic mimicry highlights the close relationship between what we perceive and how we behave, a link that has been corroborated by neuro-imaging studies identifying ''mirror neurons'' that activate both when observing a movement and performing it (Rizzolatti & Craighero, 2004). Such ''internal'' or ''covert'' imitation has been hypothesized to related to how we perceive and comprehend heard music (Godøy, Song, Nymoen, Haugen, & Jensenius, 2016;Leman, 2008). This view is in line with the perspective of embodied cognition, the supposition that our bodily movements and sensations play an important role in how we understand and make sense of the world around us (Wilson, 2002).…”

mentioning

confidence: 86%

“…However, there are currently few studies exploring the relationship between empathy and physical engagement in dance movement, although some have conceptualized dance as a form of mimicry of music (Godøy et al, 2016;Leman, 2008). Bamford and Davidson (2017) found that higher trait empathy was associated with better adjustment to abrupt tempo changes, while Carlson et al (2016) found no relationship between empathy and adjustment to small tempo differences across stimuli.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Empathy, Entrainment, and Perceived Interaction in Complex Dyadic Dance Movement

2019

View full text Add to dashboard Cite

The current study explores how individuals' tendency to empathize with others (trait empathy) modulates interaction and social entrainment in dyadic dance in a free movement context using perceptual and computationally derived measures. Stimuli consisting of 24 point-light animations were created using motion capture data selected from a sample of 99 dyads, based on self-reported trait empathy. Individuals whose Empathy Quotient (EQ) scores were in the top or bottom quartile of all scores were considered to have high or low empathy, respectively, and twelve dyads comprised of four high-high, four low-low, and four high-low empathy combinations were identified. Animations of these dyads were presented to 33 participants, who rated the degree of interaction and movement similarity for each stimulus. Results showed a significant effect of empathy combination on perceived interactivity and perceived similarity. High-low stimuli were rated as significantly more interactive than either high-high or low-low stimuli, while high-high stimuli were rated as significantly less similar than high-low and low-low. Dyads’ period-locking, bodily orientation and amount of hand movement were all significantly correlated with rated amount of interaction, while rated similarity only related significantly to period-locking. Results suggest that period-locking is important for social entrainment to be perceived, but that other signals such as bodily orientation and hand movement also signal social entrainment during free dance movement.

show abstract

mentioning

confidence: 86%

mentioning

confidence: 99%

Empathy, Entrainment, and Perceived Interaction in Complex Dyadic Dance Movement

2019

View full text Add to dashboard Cite

show abstract

“…Individual sounds correspond to individual movements, which serve as basic building blocks of multi-modal stimuli (movement-sounds) and create the possibility for longer, multi-modal combinations of movement and sound. Effenberg [10] discusses the enhanced impact of multi-modal stimuli on motor perception, and Godøy [29] reasons that three motioneffort shapes: Impulsive, Sustained, and Iterative, informs crossmodal perception of sound and movement. The incorporation of peak emphasis into our design characterizes the shape of our sounds in accordance with two of Godøy's Shape descriptions: Impulsive and Sustained [29].…”

Section: Discussionmentioning

confidence: 99%

“…Effenberg [10] discusses the enhanced impact of multi-modal stimuli on motor perception, and Godøy [29] reasons that three motioneffort shapes: Impulsive, Sustained, and Iterative, informs crossmodal perception of sound and movement. The incorporation of peak emphasis into our design characterizes the shape of our sounds in accordance with two of Godøy's Shape descriptions: Impulsive and Sustained [29]. We did not find enough qualitative or quantitative evidence to help us construct the third sound shape, Iterative.…”

Section: Discussionmentioning

confidence: 99%

Empirically Informed Sound Synthesis Application for Enhancing the Perception of Expressive Robotic Movement

Bellona¹,

Bai²,

Dahl³

et al. 2017

Proceedings of the 23rd International Conference on Auditory Display - ICAD 2017

View full text Add to dashboard Cite

Since people often communicate internal states and intentions through movement, robots can better interact with humans if they too can modify their movements to communicate changing state. These movements, which may be seen as supplementary to those required for workspace tasks, may be termed “expressive.” However, robot hardware, which cannot recreate the same range of dynamics as human limbs, often limit expressive capacity. One solution is to augment expressive robotic movement with expressive sound. To that end, this paper presents an application for synthesizing sounds that match various movement qualities. Its design is based on an empirical study analyzing sound and movement qualities, where movement qualities are parametrized according to Laban’s Effort System. Our results suggests a number of correspondences between movement qualities and sound qualities. These correspondences are presented here and discussed within the context of designing movement-quality-to-sound-quality mappings in our sound synthesis application. This application will be used in future work testing user perceptions of expressive movements with synchronous sounds.

show abstract

“…cognitive aspects of such motion have been explained through experimental listener studies [2], and by comparing the relationship of sound and music features in various contexts [6].…”

Section: Introductionmentioning

confidence: 99%

Representation Strategies in Two-handed Melodic Sound-Tracing

Kelkar

Jensenius

2017

Proceedings of the 4th International Conference on Movement Computing

Self Cite

View full text Add to dashboard Cite

is paper describes an experiment in which the subjects performed a sound-tracing task to vocal melodies. ey could move freely in the air with two hands, and their motion was captured using an infrared, marker-based system. We present a typology of distinct strategies used by the recruited participants to represent their perception of the melodies. ese strategies appear as ways to represent time and space through the nite motion possibilities of two hands moving freely in space. We observe these strategies and present their typology through qualitative analysis. en we numerically verify the consistency of these strategies by conducting tests of signi cance between labeled and random samples.

show abstract

Exploring Sound-Motion Similarity in Musical Experience

Cited by 25 publications

References 36 publications

Empathy, Entrainment, and Perceived Interaction in Complex Dyadic Dance Movement

Empathy, Entrainment, and Perceived Interaction in Complex Dyadic Dance Movement

Empirically Informed Sound Synthesis Application for Enhancing the Perception of Expressive Robotic Movement

Representation Strategies in Two-handed Melodic Sound-Tracing

Contact Info

Product

Resources

About