Spatial Sound and Multimodal Interaction in Immersive Environments

Grani, Francesco; Overholt, Dan; Erkut, Cumhur; Gelineck, Steven; Triantafyllidis, Georgios; Nordahl, Rolf; Serafin, Stefania

doi:10.1145/2814895.2814919

Cited by 6 publications

(1 citation statement)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Spatial sound in virtual reality Spatial sound in VR has being studied not only for orientation but from a broader perspective, as in Begault and Trejo's book [3] and Cohen and Barfield's special issue [9], where papers range from spatial sound perception to more applied uses. Grani et al [18] also present a collection of research focused on two primary areas of sound in VR: the creation of interactive audio experiences, and production of spatial audio for cinema and creative contexts. Concerning manipulation, Jordan et al [23] proposed a tool for spatially manipulating sound and music in space of a VR environment.…”

Section: Background and Related Workmentioning

confidence: 99%

"When the Elephant Trumps"

Bala

Masu

Nisi

et al. 2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Orientation is an emerging issue in cinematic Virtual Reality (VR), as viewers may fail in locating points of interest. Recent strategies to tackle this research problem have investigated the role of cues, specifically diegetic sound effects. In this paper, we examine the use of sound spatialization for orientation purposes, namely by studying different spatialization conditions ("none", "partial", and "full" spatial manipulation) of multitrack soundtracks. We performed a between-subject mixed-methods study with 36 participants, aided by Cue Control, a tool we developed for dynamic spatial sound editing and data collection/analysis. Based on existing literature on orientation cues in 360 • and theories on human listening, we discuss situations in which the spatialization was more effective (namely, "full" spatial manipulation both when using only music and when combining music and diegetic effects), and how this can be used by creators of 360 • videos. CCS CONCEPTS • Human-centered computing → Virtual reality; Auditory feedback; Empirical studies in HCI .

show abstract

Section: Background and Related Workmentioning

confidence: 99%