Piano Technique as a Case Study in Expressive Gestural Interaction

McPherson, Andrew; Kim, Youngmoo E.

doi:10.1007/978-1-4471-2990-5_7

Cited by 7 publications

(7 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Other examples include Prechtl et al (2012), Holland and Elsom-Cook (1990) and Milne et al (2011aMilne et al ( , 2011b. There are strong overlaps between spatial cognition, gesture and embodiment, as explored in chapter 6 (Bouwer et al 2013a), chapter 7 (McPherson et al 2013) and chapter 15 (Wilkie et al 2013). See also sections 2.5, 2.9, and 2.16 in this chapter.…”

Section: What Role Does Spatial Cognition Play In Music Interaction?mentioning

confidence: 91%

“…At the same time, there are presently limitations to the effectiveness of formal languages as means of controlling live musical performances. To look at this from another perspective, gestures are intrinsic to the way many musicians engage with music, as explored in detail in chapter 7 by McPherson and Kim (2013).…”

Section: How Can Formal Language and Gesture Be Integrated In Music Imentioning

confidence: 99%

See 1 more Smart Citation

Music Interaction: Understanding Music and Human-Computer Interaction

Holland

Wilkie

Mulholland

et al. 2013

Music and Human-Computer Interaction

View full text Add to dashboard Cite

Section: What Role Does Spatial Cognition Play In Music Interaction?mentioning

confidence: 91%

Section: How Can Formal Language and Gesture Be Integrated In Music Imentioning

confidence: 99%

Music Interaction: Understanding Music and Human-Computer Interaction

Holland

Wilkie

Mulholland

et al. 2013

Music and Human-Computer Interaction

View full text Add to dashboard Cite

“…Its pedal sensing capability however is limited to discrete positions that only provides on/off information. McPherson and Kim [14] modified the PianoBar in order to provide a continuous stream of position information, but thus far few detailed studies have made use of the pedal data. These problems have motivated us to develop a dedicated, portable, and non-intrusive system to measure continuous pedaling gestures for our further analysis.…”

Section: Related Workmentioning

confidence: 99%

Measurement, Recognition, and Visualization of Piano Pedaling Gestures and Techniques

Liang¹,

Fazekas²,

Sandler³

2018

J. Audio Eng. Soc.

View full text Add to dashboard Cite

This paper presents a study of piano pedaling gestures and techniques on the sustain pedal from the perspective of measurement, recognition, and visualization. Pedaling gestures can be captured by a dedicated measurement system where the sensor data can be simultaneously recorded alongside the piano sound under normal playing conditions. Using the sensor data collected from the system, the recognition is comprised of two separate tasks: pedal onset/offset detection and classification by technique. The onset and offset times of each pedaling technique were computed using signal processing algorithms. Based on features extracted from every segment when the pedal is pressed, the task of classifying the segments by pedaling technique was undertaken using machine learning methods. We compared Support Vector Machines (SVM) and hidden Markov models (HMM) for this task. Our system achieves high accuracies, over 0.7 F1 score for all techniques and over 0.9 on average. The recognition results can be represented using novel pedaling notations and visualized in an audio-based score following application.

show abstract

“…7 ("Piano Technique as a Case Study in Expressive Gestural Interaction") of this book, McPherson and Kim (2013) explore how perspectives drawn from Music Interaction can be used to cast light on the nature of expressive expert performance on traditional keyboard instruments. They further use the resulting analysis to pioneer new and subtler means of expression.…”

Section: How Can Music Interaction Benefit Traditional Musical Instrumentioning

confidence: 99%

“…To look at this from another perspective, gestures are intrinsic to the way many musicians engage with music, as explored in detail in Chap. 7 ("Piano Technique as a Case Study in Expressive Gestural Interaction") by McPherson and Kim (2013).…”

Section: How Can Formal Language and Gesture Be Integrated In Music Imentioning

confidence: 99%

Music and Human-Computer Interaction

Holland¹,

Wilkie²,

Mulholland³

et al. 2013

Springer Series on Cultural Computing

View full text Add to dashboard Cite

Musical instruments have a property of long-term engagement: people frequently become so engaged with them that they practice and play them for years, despite receiving no compensation other than enjoyment. We examine this phenomenon by analysing how the intrinsic motives mastery, autonomy, and purpose are built into the design of musical instruments; because, according to the self-determination theory of motivation, these three motives impact whether an activity might be found enjoyable. This analysis resulted in the identification of seven abstract qualities, inherent to the activity of music making or to the design of musical instruments, which contribute to the three intrinsic motives. These seven qualities can be treated as heuristics for the design of human-computer interfaces that have long-term engagement. These heuristics can be used throughout the design process, from the preliminary stage of idea generation to the evaluation stage of finished prototypes. Interfaces with instrument-like long-term engagement would be useful in many applications, both inside and outside the realm of music: they seem particularly suited for applications based on the attainment of long-term goals, which can be found in fields such as physical fitness, rehabilitation, education, and many others. In this chapter, we discuss an interface prototype we created and its pending evaluation. This interface, a rehabilitative rhythm game, serves as a case study showing how the heuristics might be used during the design process.

show abstract

Piano Technique as a Case Study in Expressive Gestural Interaction

Cited by 7 publications

References 11 publications

Music Interaction: Understanding Music and Human-Computer Interaction

Music Interaction: Understanding Music and Human-Computer Interaction

Measurement, Recognition, and Visualization of Piano Pedaling Gestures and Techniques

Music and Human-Computer Interaction

Contact Info

Product

Resources

About