A Basic Study on the System of Converting Color Image into Sound

Abstract

This paper aims for developing the intelligent robot emulating human synesthetic skills which associate a color image with sound, so that we are able to build an application system based on the principle of mutual conversion between color image and sound. As the first step, in this study, we have tried to realize a basic system using the color image to sound conversion. This study describes a new conversion method to convert color image into sound, based on the likelihood in the physical frequency information between light and sound. In addition, we present the method of converting color image into sound using color model conversion as well as histograms in the converted color model. In the basis of the method proposed in this study, we built a basic system using Microsoft Visual C++(ver. 6.0). The simulation results revealed that the hue, saturation and intensity elements of a input color image were converted into F0, harmonic and octave elements of a sound, respectively. The converted sound elements were synthesized to generate a sound source with WAV file format using Csound toolkit.

Painterly Rendering Based on Piano Interface

“…Especially the ancient physicist Newton scientifically proved the similarity of sound and color as dividing the lights into seven colors and comparing each color to the wavelength. As a similar study, there are researches that attempt to express the sound in the color by one to one corresponding the sound and color [9,10]. A painter Kandinsky [11] who studied in earnest about the correlation between the sound and the color reveals that each different colors have their own feelings as each different instrument has a unique tone.…”