Designing an Interactive and Collaborative Experience in Audio Augmented Reality

Abstract

Audio Augmented Reality (AAR) consists of adding spatial audio entities into the real environment. Existing mobile applications and technologies open questions around interactive and collaborative AAR. This paper proposes an experiment to examine how spatial audio can prompt and support actions in interactive AAR experiences; how distinct auditory information influence collaborative tasks and group dynamics; and how gamified AAR can enhance participatory storytelling. We are developing an interactive multiplayer experience in AAR using the Bose Frames audio sunglasses. Four participants at a time will go through a gamified story that attempts to interfere with group dynamics. In this paper we present our AAR platform and collaborative game in terms of experience design, and detail the testing methodology and analysis that we will conduct to answer our research questions.

Breaking through Barriers: A Systematic Review of Extended Reality in Education for the Visually Impaired

“…Research studies by [68][69][70] highlight the importance of multi-user XR and group work in educational settings, particularly for individuals with visual impairments. Ref.…”

“…Ref. [70] studied the use of spatial audio in audio AR experiences, showcasing how technologies like Bose "Frames" enhance collaboration in multiplayer settings. These studies emphasise the positive impact of interactive technologies on collaboration, inclusion, and learning outcomes for VI students, calling for further research to fully explore their potential in education.…”

An Augmented Reality Piano Learning Tool

“…Indeed, the audio and visual feedback provided by the app through AR technology can stimulate multiple learning channels simultaneously and help to develop young learners' visual [19], auditory [20], and motor skills [21]. Starting from the applications already described, our application continues to offer new ways to teach people how to play piano using AR and without needing to know or learn the music notation.…”

Augmenting TV Viewing using Acoustically Transparent Auditory Headsets

“…However, for general media/TV usage participants were largely neutral regarding their likelihood of usage, perhaps reflecting the lack of experience of such a use case. In addition to uses such as in collaboration proposed by Bauer et al [1], McGill et al [31] suggested that such headsets could be effectively integrated into a variety of day-to-day activities, particularly in TV where they might enable "private speech support for those with visual impairments; personal audio for multi-view TV; or even additional immersive spatial audio effects supplementing any display with surround sound capabilities".…”