A Visual Framework For Dynamic Mixed Music Notation

Abstract

We present a visual notation framework for real-time, score-based computer music where human musicians play together with electronic processes, mediated by the Antescofo reactive software. This framework approaches the composition and performance of mixed music by displaying several perspectives on the score's contents. Our particular focus is on dynamic computer actions, whose parameters are calculated at run-time. For their visualization, we introduce four models: an extended action view, a staff-based simulation trace, a tree-based hierarchical display of the score code, and an out-of-time inspector panel. Each model is illustrated in code samples and case studies from actual scores. We argue the benefits of a multifaceted visual language for mixed music, and for the relevance of our proposed models towards reaching this goal.

Extending Music Notation as a Programming Language for Interactive Music

“…Some musical software tools have tried to make the encoded performance logic more readable for musicians by mixing standard staf notation with their custom programming language syntax. For example, NoteAbilityPro [7] and Ascograph [2]. However, in these tools, the music representation of the performance information is still highly dependent on the technological platform that drives the digital instrument.…”

“…For example, at the third measure where the 'D.S. [1,2]' phonetic annotation is located, if the pianist plays next C4 and E4, the program will jump to the second measure, but if instead, the pianist plays C4 and A4, the program will jump to the frst measure. It is worth noting that if the condition is not meet for any of the tags, the program will continue to the following measure, in this case, the fourth measure.…”