Development of an algorithm for media conversion between music and color combination based on impressions

Abstract

We propose a new method to realize a media conversion between music and color combination based on impressions. In order to synchronize color combination with music, we focus on time-series changing of musical impressions. Our proposed method divides an input music into some subsequences and a color combination is assigned to each subsequence. In the subjective assessment, the impressions for each sub-sequence are evaluated, and we develop an algorithm to derive the most appropriate color combination to the impressions of each sub-sequence. From the experimental results using five musical sources, the average of concordance rate between music and the derived color combinations in our algorithm is about 83%. In this research, it is clarified that the degree of impressional similarity between music and color combination in media conversion is improved by our algorithm considering the time-series changing of musical impressions.