Synaesthetic Sanctuary

Abstract

<p><b>Traditional scientific methods of visualising sound data have focused on techniques that attempt to capture distinct elements of the audio signal, such as volume and length. However, existing methods such as spectrograms and waveform analysis are limited in their expression of the characteristics associated with complex sounds such as bird song. This research explores strategies to visualise sound in an aesthetically engaging manner. It uses sound data from native New Zealand birds as a design tool for creating an audio-visual design system. The distinct focus on timing and pitch within these songs makes the data suitable for visual comparison. The design techniques explored throughout this research project attempt to express the unique characteristics of a variety of New Zealand bird songs and calls. It investigates how artistic audio-visual methods can be integrated with scientific techniques so that the auditory data can be made more accessible to non-specialists.</b></p> <p>More specifically, this research aims to take advantage of the natural phonaesthetic connections people make between sonic and visual elements. The final output of this research consists of a generative design system that uses auditory data to create visualisations of New Zealand bird song. These visualisations have a mathematical basis, as well as being audio-visual artworks in themselves.</p>