Three-dimensional sound-field visualization system using head mounted display and stereo camera

Abstract

Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an optical head mounted display (OHMD) have been rapidly developed. In this study, we propose a sound field visualization system using an OHMD and a handheld four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and user’s head are acquired via AR markers and a gyro sensor of the OHMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound field generated by a two-way loudspeaker was visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.