The sound of light

Abstract

This paper presents a novel approach to assist users of digital cameras and augment their photograph taking experience. To this end, a realtime analysis of the images framed by the camera is conducted to assess composition, exposure and presence of human subjects. The resulting information is used to give users feedback about their photographs before they release the shutter. The main contribution of this paper is the use of synesthetic feedback: a musical composition that maps aspects resulting from the realtime analysis of images is composed and played back to the photographer. A preliminary study shows that musical attributes can be controlled to provide effective feedback about the visual modality.