Synthesizing Expressive Music Through the Language of Conducting

Nakra, Teresa Marrin

doi:10.1076/jnmr.31.1.11.8102

Cited by 9 publications

(1 citation statement)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These visual events have been called 'beats' in Ref. [25] and are typically described as the conductor baton's change in direction from a downward to an upward motion [26]. Outside of traditional conducting studies, research on clarinetist's movements found that 'movements related to structural characteristics of the piece (e.g., tempo)' were consistently found among player subjects, such as 'tapping of one's foot or the moving of the bell up and down to keep rhythm' [27].…”

Section: Visual Cuesmentioning

confidence: 99%

A Musical Robot that Synchronizes with a Coplayer Using Non-Verbal Cues

et al. 2012

View full text Add to dashboard Cite

Music has long been used to strengthen bonds between humans. In our research, we develop musical coplayer robots with the hope that music may improve human-robot symbiosis as well. In this paper, we underline the importance of non-verbal, visual communication for ensemble synchronization at the start, during and end of a piece. We propose three cues for interplayer communication, and present a thereminplaying, singing robot that can detect them and adapt its play to a human flutist. Experiments with two naive flutists suggest that the system can recognize naturally occurring flutist gestures without requiring specialized user training. In addition, we show how the use of audio-visual aggregation can allow a robot to adapt to tempo changes quickly.

show abstract

Section: Visual Cuesmentioning

confidence: 99%