Measures such as entropy and mutual information can be used to characterise random processes. In this paper, we propose the use of several time-varying information measures, computed in the context of a probabilistic model which evolves as a sample of the process unfolds, as a way to characterise temporal structure in music. One such measure is a novel predictive information rate which we conjecture may provide a conceptually simple explanation for the 'inverted-U' relationship often found between simple measures of randomness (e.g. entropy rate) and judgements of aesthetic value (1). We explore these ideas in the context of Markov chains using both artificially generated sequences and two pieces of minimalist music by Philip Glass, showing that even such a manifestly simplistic model (the Markov chain), when interpreted according to information dynamic principles, produces a structural analysis which largely agrees with that of an expert human listener. Thus, we propose that our approach could form the basis of a theoretically coherent yet computationally plausible model of human perception of formal structure, potentially including seemingly abstract qualities like interestingness and aesthetic goodness.Keywords: information theory; expectation; surprise; subjective probability; Bayesian inference; Markov chain; music.
Expectation and surprise in musicOne of the more salient effects of listening to music is to create expectations of what is to come next, which may be fulfilled immediately, after some delay, or not at all as the case may be. This is the thesis put forward by, amongst others, music theorists L. B. Meyer (2) and Narmour (3). In fact, this insight predates Meyer quite considerably; for example, it was elegantly put by Hanslick (4) in the nineteenth century: 'The most important factor in the mental process which accompanies the act of listening to music, and which converts it to a source of pleasure, is frequently overlooked. We here refer to the intellectual satisfaction which the listener derives from continually following and anticipating the composer's intentions-now, to see his expectations fulfilled, and now, to find himself agreeably mistaken. It is a matter of course that this intellectual flux and reflux, this perpetual giving and receiving takes place unconsciously, and with the rapidity of lightning-flashes. ' An essential aspect of this is that music is experienced as a phenomenon that 'unfolds' in time, rather than being apprehended as a static object presented in its entirety. Meyer argued that musical experience depends on how we change and revise our conceptions as events happen, on how expectation and prediction interact with occurrence, and that, to a large degree, the way to understand the effect of music is to focus on this 'kinetics' of expectation and surprise. The business of making predictions and assessing surprise is essentially one of reasoning under conditions of uncertainty and manipulating degrees of belief about the various proposition which may or may not hold, an...