An Analysis of Low-Arousal Piano Music Ratings to Uncover What Makes Calm and Sad Music So Difficult to Distinguish in Music Emotion Recognition

Abstract

Music emotion recognition and recommendation systems often use a simplified 4-quadrant model with categories such as Happy, Sad, Angry, and Calm. Previous research has shown that both listeners and automated systems often have difficulty distinguishing low-arousal categories such as Calm and Sad. This paper seeks to explore what makes the categories Calm and Sad so difficult to distinguish. We used 300 low-arousal excerpts from the classical piano repertoire to determine the coverage of the categories Calm and Sad in the low-arousal space, their overlap, and their balance to one another. Our results show that Calm was 40% bigger in terms of coverage than Sad, but that on average Sad excerpts were significantly more negative in mood than Calm excerpts were positive. Calm and Sad overlapped in nearly 20% of the excerpts, meaning 20% of the excerpts were about equally Calm and Sad. Calm and Sad covered about 92% of the low-arousal space, where 8% of the space were holes that were not-at-all Calm or Sad. The largest holes were for excerpts considered Mysterious and Doubtful, but there were smaller holes among positive excerpts as well. Due to the holes in the coverage, the overlaps, and imbalances the Calm-Sad model adds about 6% more errors when compared to asking users directly whether the mood of the music is positive or negative. Nevertheless, the Calm-Sad model is still useful and appropriate for applications in music emotion recognition and recommendation such as when a simple and intuitive interface is preferred or when categorization is more important than precise differentiation.

Time-of-day practices echo circadian physiological arousal: An enculturated embodied practice in Hindustani classical music

“…The conflation of low arousal and melancholy is highlighted in the field of automated music emotion recognition where algorithmic audio analysis is used to identify different musical affects for the purpose of music recommendation systems. A particularly thorny issue in the field is known as the calm-sad problem (Hong et al, 2017, p. 304). Both human listeners and automated algorithms have difficulty distinguishing calm music from sad (melancholic) music.…”

TROMPA-MER: an open dataset for personalized music emotion recognition

“…MER has been subject to extensive criticism given the ambiguous and subjective nature of emotions in music (Sturm, 2013;Hong et al, 2017;Lange & Frieler, 2018;Schedl et al, 2018;Vempala & Russo, 2018;Grekow, 2021). Namely, different listeners are likely to provide diverse emotional judgments due to several factors: (1) intrinsic constructions of music (e.g., lyrics content and style), (2) socio-cultural conventions (e.g., functionality of music), (3) personal differences (e.g., listener's mood, preferences, personality, and musical experience), (4) high-level emotional evaluation mechanisms (e.g., language differences, aesthetic experience, familiarity, episodic memory, and identity confirmation), and (5) generalized confusion between the concepts of induced and perceived emotions in music.…”

Algorithm Composition and Emotion Recognition Based on Machine Learning

“…However, this method has certain limitations on the accuracy of preprocessing of music data. Hong et al adopted a trained LSTM to predict the next note in a monophonic melody and used reinforcement learning to enhance it [ 13 ].…”