A Study on Learning Advanced Skills on Co-Playable Robotic Instruments

Abstract

Learning advanced skills on a musical instrument takes a range of physical and cognitive efforts. For instance, practicing polyrhythm is a complex task that requires the development of both musical and physical skills. This paper explores the use of automation in the context of learning advanced skills on the guitar. Our robotic guitar is capable of physically plucking on the strings along with a musician, providing both haptic and audio guidance to the musician. We hypothesize that a multimodal and firstperson experience of "being able to play" could increase learning efficacy. We discuss the novel learning application and a user study, through which we illustrate the implication and potential issues in systems that provide temporary skills and in-situ multimodal guidance for learning.

The Proto-Langspil: Launching an Icelandic NIME Research Lab with the Help of a Marginalised Instrument

“…Combining small scale studies and "art-research inquiry" [30] in our "machinic encounters" [31] has allowed us to begin to see promising connections, between the music interaction affordances and sensorimotor disruptions [32] of nonlinear dynamics [33][34], and their impact on advanced skill learning [35], AI mind perception in the case of E3P1 [36][37], and AI expectation violation in the case of E3P2 [38]. However, we did so in only very short glimpses, and with an extremely limited vocabulary.…”