RESound

Taylor, Micah; Chandak, Anish; Antani, Lakulish; Manocha, Dinesh

doi:10.1145/1631272.1631311

Cited by 54 publications

(14 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In 2009, Taylor et al used techniques of computer graphics to combine the Uniform Theory of Diffraction (UTD) formulation with the ray-frustum procedure, which expands more frusta at defined edges and identifies covered sources in the shadow zone [Tay+09a;Tay+09b]. It is stated that this approach is able to achieve sufficiently high update rates for real-time applications using regular, multicore processors, which is an appealing feature for interactive outdoor environments.…”

Section: Acoustic Diffraction Modelsmentioning

confidence: 99%

Real-Time Auralisation of Outdoor Sound Propagation

Stienen¹

2023

View full text Add to dashboard Cite

Auralisation describes the process of generating and presenting audible sound using computer programs and audio hardware. Since the result is perceived naturally by the human's auditory system, a demonstration by means of auralisation is easily comprehensible and does neither require background knowledge nor expertise. Producing auralisation under real-time constraints increases the implementation demands significantly. Real-time auralisation is required in applications that respond to user interaction, for example, in interactive Virtual Reality (VR) environments. Dynamically moving sound sources and receivers evoke a change in the perceived sound, and the corresponding result must be provided as quickly as possible. A feeling of immersion can be created if the response time of the system does not exceed perceptual thresholds and thus enables a plausible scene presentation. To achieve this emotional state, real-time auralisation must comply with the expected physical behavior. Because auralisation has gained much attention in room acoustics, the established concepts and approaches are insufficient, if applied to outdoor scenarios. This is due to the fact that simulation principles based on Geometrical Acoustics (GA) can determine specular sound reflection with ease, but only rudimentarily incorporate the contribution of diffracted sound. Nonetheless, the transmission of sound from a source to a receiver in an urban setting contains a significant contribution of reflected and diffracted components. Furthermore, highly dynamic virtual environments are time-variant. Traditional realisations neglect this characteristic, treating an acoustic environment as temporarily static on a frame-by-frame basis. Adaption to dynamic events is implemented by update routines performing sequences of time-invariant simulations, which is contradictory to the highly dynamic nature of outdoor scenarios. This misconception is addressed in this dissertation and an alternative solution is suggested. The realisation of a real-time auralisation application for outdoor environments represents a promising addition to current noise assessment procedures. It also delivers the foundation for auditory modality in VR regarding outdoor scenarios, serving as an audio-video tool for scientific investigations of urban sound environments, accounting for perceptual aspects. der PDs und die Zuordnung individueller Wellenfronten basiert auf einer Winkeldistanzmetrik ("k-means clustering") und die Korrektur der ITD berücksichtigt die Abweichungen im Azimut. Die Machbarkeit des vorgeschlagenen Echtzeit-Auralisierungssystems und die Eignung für die Schallausbreitung im Freien werden in einer interaktiven Applikation demonstriert, die auf VR-Technologien basiert.For the young who are inspiring me, the old who ground me and my dearest who holds everything together.

show abstract

Section: Acoustic Diffraction Modelsmentioning

confidence: 99%

Real-Time Auralisation of Outdoor Sound Propagation

Stienen¹

2023

View full text Add to dashboard Cite

show abstract

“…Once rays are emitted from a sound source, those rays are propagated into the free space and interacted with obstacles according to specular and diffuse reflections or diffraction. The image-source methods 21,22 were proposed to calculate the specular reflection, and the Monte Carlo path tracing methods [23][24][25][26] were proposed to calculate the diffuse reflection. The uniform theory of diffraction 27 was used to describe the characteristics of waves, such as diffraction in the low-frequency band.…”

Section: Physically Based Sound Renderingmentioning

confidence: 99%

“…However, due to the We utilize a geometric-based sound path propagation method to implement the optimization-based approaches and generate the IR. The image-source method 21 and the Monte Carlo path tracing method 24 are used for generating specular reflection and diffuse reflection of sound paths. We also apply the uniform theory of diffraction 27 to describe the diffraction path.…”

Section: Environment Settingsmentioning

confidence: 99%

Inexpensive indoor acoustic material estimation for realistic sound propagation

Kim

Yoon

2022

Computer Animation & Virtual

View full text Add to dashboard Cite

For the realistic and immersive experience in a virtual environment, it is important to estimate and reflect the acoustic characteristic of the real indoor scenes. This article proposes a method of directly measuring the reflection coefficient of a surface, which is an acoustic characteristics in the real environment. Because expensive optimization‐based studies that mainly aim to reproduce recorded sounds indirectly estimate acoustic materials, new estimates are required whenever the actual environment changes. Our approach utilizes the method of the acoustics field to enable anyone to easily and directly measure the reflection coefficient of a real environment and generate sound in a virtual environment. We obtain the impulse response (IR) for the target surface, separate the direct sound and the reflected sound, and calculate the reflection coefficient for each surface. The measurement of the IR and the reflection coefficient calculation takes about 2 s. Our result produces a sound with a similar reverberation time to the sound recorded in the real environment.

show abstract

“…Sound rendering is regarded as a techniques to overcome these limitations by simulating and tracing the sound propagation paths between the listener and sound source. Sound rendering can be classified into two categories: the numerical method and the geometric method [14].…”

Section: Related Workmentioning

confidence: 99%

“…The numerical method solves the wave equation mathematically to process sound propagation [15,16,17]. The result of the numerical method is more accurate than the geometric method, but an interactive rate processing could not be achieved because of a huge amount of calculation cost [14]. For this reason, the numerical method has been used only for processing static scenes.…”

Section: Related Workmentioning

confidence: 99%

Real-time 3D Audio Downmixing System based on Sound Rendering for the Immersive Sound of Mobile Virtual Reality Applications

2018

KSII TIIS

View full text Add to dashboard Cite

Eight out of the top ten the largest technology companies in the world are involved in some way with the coming mobile VR revolution since Facebook acquired Oculus. This trend has allowed the technology related with mobile VR to achieve remarkable growth in both academic and industry. Therefore, the importance of reproducing the acoustic expression for users to experience more realistic is increasing because auditory cues can enhance the perception of the complicated surrounding environment without the visual system in VR. This paper presents a audio downmixing system for auralization based on hardware, a stage of sound rendering pipelines that can reproduce realiy-like sound but requires high computation costs. The proposed system is verified through an FPGA platform with the special focus on hardware architectural designs for low power and real-time. The results show that the proposed system on an FPGA can downmix maximum 5 sources in real-time rate (52 FPS), with 382 mW low power consumptions. Furthermore, the generated 3D sound with the proposed system was verified with satisfactory results of sound quality via the user evaluation.

show abstract

RESound

Cited by 54 publications

References 34 publications

Real-Time Auralisation of Outdoor Sound Propagation

Real-Time Auralisation of Outdoor Sound Propagation

Inexpensive indoor acoustic material estimation for realistic sound propagation

Real-time 3D Audio Downmixing System based on Sound Rendering for the Immersive Sound of Mobile Virtual Reality Applications

Contact Info

Product

Resources

About