Abstract. In our engagement with music, not only the physical experience of sound is important. Also the interplay between body movements, musical gestures and the cognitive processes of performers and listeners is part of our experience. Yet, this multimodal aspect is not always fully considered when analyzing music performance. In this paper, we want to establish a framework for a multi-layered analysis of music performance, building on data retrieved from quantitative and qualitative procedures and involving the perspectives of composer, performer and musicologist. The performance of a classical guitarist was analyzed in detail, using both a 'bottom-up' approach (audio-analysis and motion-capture) and a 'top-down' perspective (annotations from video-footage by composer, musician and researchers). These different analytical layers were compared and evaluated, which pointed out that multiple perspectives can reinforce each other in detecting musical targets and can help detecting mismatches between qualitative and quantitative data.

The Global Hyperorgan is an intercontinental, creative space for acoustic musicking.Existing pipe organs around the world are networked for real-time, geographicallydistant performance, with performers utilizing instruments and other input devices to collaborate musically through the voices of the pipes in each location. A pilot study was carried out in January 2021, connecting two large pipe organs in Piteå, Sweden, and Amsterdam, the Netherlands. A quartet of performers tested the Global Hyperorgan's capacities for telematic musicking through a series of pieces. The concept of modularity is useful when considering the artistic challenges and possibilities of the Global Hyperorgan. We observe how the modular system utilized in the pilot study afforded multiple experiences of shared instrumentality from which new, synthetic voices emerge. As a long-term technological, artistic and social research project, the Global Hyperorgan offers a platform for exploring technology, agency, voice, and intersubjectivity in hyper-acoustic telematic musicking.

No abstract

This chapter investigates the relationship between the fluid practices that frequently characterize the work of contemporary musicians, and the more solid roles of performer and composer that continue to hold sway in contemporary music. Focusing on a case study of the collaborative creation of Forlorn Hope for eleven-string alto guitar and electronics, by Gorton and Östersjö, the chapter analyses the processes that lead from research and experimentation with particular guitar tunings and playing techniques, through a more conventionally compositional phase, to the first public performance of the piece. The chapter demonstrates how the affordances of both the instrument in the hands of Östersjö and the particular tuning specified by Gorton combined with improvised discoveries, and the ‘filtering’ force of a piece by Dowland, result in a piece whose creative ecology is distributed across a variety of timescales and practices.

Musical performance is a multimodal experience, for performers and listeners alike. This paper reports on a pilot study which constitutes the first step toward a comprehensive approach to the experience of music as performed. We aim at bridging the gap between qualitative and quantitative approaches, by combining methods for data collection. The purpose is to build a data corpus containing multimodal measures linked to high-level subjective observations. This will allow for a systematic inclusion of the knowledge of music professionals in an analytic framework, which synthesizes methods across established research disciplines. We outline the methods we are currently developing for the creation of a multimodal data corpus dedicated to the analysis and exploration of instrumental music performance from the perspective of embodied music cognition. This will enable the study of the multiple facets of instrumental music performance in great detail, as well as lead to the development of music creation techniques that take advantage of the cross-modal relationships and higher-level qualities emerging from the analysis of this multi-layered, multimodal corpus. The results of the pilot project suggest that qualitative analysis through stimulated recall is an efficient method for generating higher-level understandings of musical performance. Furthermore, the results indicate several directions for further development, regarding observational movement analysis, and computational analysis of coarticulation, chunking, and movement qualities in musical performance. We argue that the development of methods for combining qualitative and quantitative data are required to fully understand expressive musical performance, especially in a broader scenario in which arts, humanities, and science are increasingly entangled. The future work in the project will therefore entail an increasingly multimodal analysis, aiming to become as holistic as is music in performance.