No abstract

In this study, a high presence virtual reality (VR) system which integrates head mount display (HMD) and the binaural sound field rendering is developed. To realize a high presence VR system, it is necessary to provide interactive visual and sound environments in real-time. Recent VR systems can provide interactive visual environment by HMD; however, interactive sound environment is not enough, because enormous binaural room impulse responses (BRIRs) are required to obtain HRTFs at various room positions. So, we calculate BRIRs numerically using the CE-FDTD method with the GPU cluster system. For BRIR calculation, a room model including dummy-head scanned by 3D scanner is developed. In this system, it is possible to render binaural-sound interactively by convolving calculated BRIRs. The developed VR system consists of visual and sound part which is respectively processed by Unity and MAX. Position and head rotation of listener are obtained from tracking sensor by Unity, and the data are sent to MAX by OSC. MAX convolves calculated BRIRs changing by cross-fade. Listener can move their head in virtual room, and can feel sound field differences. It is confirmed that the system can produce the high presence virtual room.

No abstract