Empirical Evaluation of Calibration and Long-term Carryover Effects of Reverberation on Egocentric Auditory Depth Perception in VR

Lin, Wan-Yi; Wang, Ying-Chu; Wu, Dai-Rong; Venkatakrishnan, Rohith; Venkatakrishnan, Roshan; Ebrahimi, Elham; Pagano, Christopher C.; Babu, Sabarish V.; Lin, Wen‐Chieh

doi:10.1109/vr51125.2022.00042

Cited by 6 publications

(3 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, the visual content affects the perceived audio quality [18], sound localisation (ventriloquism effect) [19][20][21][22] and distance perception of audio sources [23][24][25]. Sound localisation benefits from the presence of a visual-spatial frame [26], and visual distance perception benefits from the presence of reverberation [27]. However, the perception of reverberation may not be affected by visual room impressions in virtual environments [28].…”

Section: Visual Impact On the Perception Of Spatial Audiomentioning

confidence: 99%

Speech Intelligibility versus Congruency: User Preferences of the Acoustics of Virtual Reality Game Spaces

Popp,

Murphy

2024

Virtual Worlds

View full text Add to dashboard Cite

3D audio spatializers for Virtual Reality (VR) can use the acoustic properties of the surfaces of a visualised game space to calculate a matching reverb. However, this approach could lead to reverbs that impair the tasks performed in such a space, such as listening to speech-based audio. Sound designers would then have to alter the room’s acoustic properties independently of its visualisation to improve speech intelligibility, causing audio-visual incongruency. As user expectation of simulated room acoustics regarding speech intelligibility in VR has not been studied, this study asked participants to rate the congruency of reverbs and their visualisations in 6-DoF VR while listening to speech-based audio. The participants compared unaltered, matching reverbs with sound-designed, mismatching reverbs. The latter feature improved D50s and reduced RT60s at the cost of lower audio-visual congruency. Results suggest participants preferred improved reverbs only when the unaltered reverbs had comparatively low D50s or excessive ringing. Otherwise, too dry or too reverberant reverbs were disliked. The range of expected RT60s depended on the surface visualisation. Differences in timbre between the reverbs may not affect preferences as strongly as shorter RT60s. Therefore, sound designers can intervene and prioritise speech intelligibility over audio-visual congruency in acoustically challenging game spaces.

show abstract

Section: Visual Impact On the Perception Of Spatial Audiomentioning

confidence: 99%

Speech Intelligibility versus Congruency: User Preferences of the Acoustics of Virtual Reality Game Spaces

Popp,

Murphy

2024

Virtual Worlds

View full text Add to dashboard Cite

show abstract

“…Then, [52] used HMDs to investigate the causal agents of head trauma in athletes. Also, in [53], the authors used HMDs to compare user preferences for different virtual navigation instructions that integrate with the real environment in the MR world. Lastly, [54] built a custom HMD to evaluate performance and eye fatigue for context and focal switching in AR.…”

Section: Head-mounted Devicesmentioning

confidence: 99%

“…This classification is based on whether the experiment requires any type of response or input behavior from participants. Examples of users' feedback include asking participants to report a target's color [61], [67], to fill in a questionnaire after the experiment is over [6], [68], or automatically logged responses, such as time spent on achieving pre-set goals [53], [69], or accuracy in putting virtual objects in the correct position in the environment [70], [71]. Studies that incorporate users' responses are the most common category among the types of measurement, likely because capturing direct feedback from users is a quick and easy way to obtain experimental data.…”

Section: Categorization: Environmental Factors User or Device Measure...mentioning

confidence: 99%

Augmented Reality and Mixed Reality Measurement Under Different Environments: A Survey on Head-Mounted Devices

Guo

Bakdash

Marusich

et al. 2022

IEEE Trans. Instrum. Meas.

View full text Add to dashboard Cite

Augmented Reality (AR) and Mixed Reality (MR) have been two of the most explosive research topics in the last few years. Head-Mounted Devices (HMDs) are essential intermediums for using AR and MR technology, playing an important role in the research progress in these two areas. Behavioral research with users is one way of evaluating the technical progress and effectiveness of HMDs. In addition, AR and MR technology is dependent upon virtual interactions with the real environment. Thus, conditions in real environments can be a significant factor for AR and MR measurements with users. In this paper, we survey 87 environmental-related HMD papers with measurements from users, spanning over 32 years. We provide a thorough review of AR-and MR-related user experiments with HMDs under different environmental factors. Then, we summarize trends in this literature over time using a new classification method with four environmental factors, the presence or absence of user feedback in behavioral experiments, and ten main categories to subdivide these papers (e.g., domain and method of user assessment). We also categorize characteristics of the behavioral experiments, showing similarities and differences among papers.

show abstract

Quantifying Egocentric Distance Perception in Virtual Reality Environment

Korshunova-Fucci,

van Himbergen,

Fan

et al. 2023

International Journal of Human–Computer Interaction

View full text Add to dashboard Cite

Empirical Evaluation of Calibration and Long-term Carryover Effects of Reverberation on Egocentric Auditory Depth Perception in VR

Cited by 6 publications

References 43 publications

Speech Intelligibility versus Congruency: User Preferences of the Acoustics of Virtual Reality Game Spaces

Speech Intelligibility versus Congruency: User Preferences of the Acoustics of Virtual Reality Game Spaces

Augmented Reality and Mixed Reality Measurement Under Different Environments: A Survey on Head-Mounted Devices

Quantifying Egocentric Distance Perception in Virtual Reality Environment

Contact Info

Product

Resources

About