Binaural sound reduces reaction time in a virtual reality search task

Høeg, Emil Rosenlund; Gerry, Lynda Joy; Thomsen, Lui; Nilsson, Niels Christian; Serafin, Stefania

doi:10.1109/sive.2017.7901610

Cited by 23 publications

(15 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Firstly, results in Phase Two showed those in the 3D audio group performing significant better in the localization task. These results are consistent with similar research conducted with neurologically healthy participants, reporting that three-dimensional auditory displays can reduce localization times and improve audio spatial attention in VR [70]. Furthermore, these results provide more evidence that those with ASD are capable of successfully interpreting binaural information to take advantage of the spatial acuity provided by spatial audio rendering techniques.…”

Section: Phase Two: Spatial Audio Localization and Background Noise Tsupporting

confidence: 90%

Measuring the Behavioral Response to Spatial Audio within a Multi-Modal Virtual Reality Environment in Children with Autism Spectrum Disorder

2019

View full text Add to dashboard Cite

Virtual Reality (VR) has been an active area of research in the development of interactive interventions for individuals with autism spectrum disorder (ASD) for over two decades. These immersive environments create a safe platform in which therapy can address the core symptoms associated with this condition. Recent advancements in spatial audio rendering techniques for VR now allow for the creation of realistic audio environments that accurately match their visual counterparts. However, reported auditory processing impairments associated with autism may affect how an individual interacts with their virtual therapy application. This study aims to investigate if these difficulties in processing audio information would directly impact how individuals with autism interact with a presented virtual spatial audio environment. Two experiments were conducted with participants diagnosed with ASD (n = 29) that compared: (1) behavioral reaction between spatialized and non-spatialized audio; and (2) the effect of background noise on participant interaction. Participants listening to binaural-based spatial audio showed higher spatial attention towards target auditory events. In addition, the amount of competing background audio was reported to influence spatial attention and interaction. These findings suggest that despite associated sensory processing difficulties, those with ASD can correctly decode the auditory cues simulated in current spatial audio rendering techniques.

show abstract

Section: Phase Two: Spatial Audio Localization and Background Noise Tsupporting

confidence: 90%

Measuring the Behavioral Response to Spatial Audio within a Multi-Modal Virtual Reality Environment in Children with Autism Spectrum Disorder

2019

View full text Add to dashboard Cite

show abstract

“…Sound. Even though sound is known to aid visual processing in VR [8], they did not solely form plot points provided by the directors of the films. Sound cues that were provided were often used in conjunction with visual ones.…”

Section: Overall Findings and Discussionmentioning

confidence: 99%

Director’s Cut - Analysis of Aspects of Interactive Storytelling for VR Films

Fearghail

Özçinar

Knorr

et al. 2018

Lecture Notes in Computer Science

View full text Add to dashboard Cite

To explore methods that are currently used by professional virtual reality (VR) filmmakers to tell their stories and guide users, we analyze how end-users view 360 • video in the presence of directional cues and evaluate if they are able to follow the actual story of narrative 360 • films. In this context, we first collected data from five professional VR filmmakers. The data contains eight 360 • videos, the directors cut, which is the intended viewing direction of the director, plot points and directional cues used for user guidance. Then, we performed a subjective experiment with 20 test subjects viewing the videos while their head orientation was recorded. Finally, we present and discuss the experimental results and show, among others, that visual discomfort and disorientation on part of the viewer not only lessen the immersive quality of the films but also cause difficulties in the viewer gaining a full understanding of the narrative that the director wished them to view.

show abstract

“…Aligned with this trend, Guhnter et al [20] presented results supporting that 3D sound reduce the time required to locate objects in a complex virtual environment. Another recent study indicates that binaural audio renderings can introduce advantages to the spatial visual processing and localization [22]. Sheikh et al [43] tested several unobtrusive techniques for directing a viewer's attention discovering that the combination of audio and visual cues is more potent than visual cues alone.…”

Section: Background and Related Workmentioning

confidence: 99%

“…Furthermore, studies that focus on the usage of cues demonstrated that sound effects (diegetic cues) could effectively direct attention [17] although the importance of the spatialization of such elements is not conclusive [40]. Therefore, while the spatial rendering of sounds is generally considered as desired for the immersive and realistic representation of the virtual environment (VE) [22,41], how to use the spatial properties of sound for notification and orientation purposes is still an open research question.…”

Section: Introduction 360mentioning

confidence: 99%

"When the Elephant Trumps"

Bala

Masu

Nisi

et al. 2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Orientation is an emerging issue in cinematic Virtual Reality (VR), as viewers may fail in locating points of interest. Recent strategies to tackle this research problem have investigated the role of cues, specifically diegetic sound effects. In this paper, we examine the use of sound spatialization for orientation purposes, namely by studying different spatialization conditions ("none", "partial", and "full" spatial manipulation) of multitrack soundtracks. We performed a between-subject mixed-methods study with 36 participants, aided by Cue Control, a tool we developed for dynamic spatial sound editing and data collection/analysis. Based on existing literature on orientation cues in 360 • and theories on human listening, we discuss situations in which the spatialization was more effective (namely, "full" spatial manipulation both when using only music and when combining music and diegetic effects), and how this can be used by creators of 360 • videos. CCS CONCEPTS • Human-centered computing → Virtual reality; Auditory feedback; Empirical studies in HCI .

show abstract

Binaural sound reduces reaction time in a virtual reality search task

Cited by 23 publications

References 10 publications

Measuring the Behavioral Response to Spatial Audio within a Multi-Modal Virtual Reality Environment in Children with Autism Spectrum Disorder

Measuring the Behavioral Response to Spatial Audio within a Multi-Modal Virtual Reality Environment in Children with Autism Spectrum Disorder

Director’s Cut - Analysis of Aspects of Interactive Storytelling for VR Films

"When the Elephant Trumps"

Contact Info

Product

Resources

About