Theoretical foundations for integrating sound in interactive interfaces: identifying temporal and spatial information conveyance principles

Ahmad, Ali; Stanney, Kay M.; Fouad, Hesham

doi:10.1080/14639220701734455

Cited by 5 publications

(7 citation statements)

References 47 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The inability to accurately differentiate between sound sources can lead to increases in cognitive workload and decreases in effectiveness of task performance. Sound source localization in humans is typically described as a coordinate point with characteristic azimuth, elevation and distance relative to the listeners head position in space [2]. Horizontal plane localization refers to the azimuth and distance components of the sound source location coordinates when the elevation of the source is equal to the head height.…”

Section: Introductionmentioning

confidence: 99%

“…The cues that are typically used to predict the sound source distance include the sound intensity, the frequency content and the decay characteristics of the sound [1]. Of these cues, sound intensity is the primary cue for distance estimation [2]. There is strong evidence that when a sound source is relatively distant from the listener, the auditory cues that allow a listener to localize the sound are largely independent of distance [3,7].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Horizontal plane sound source localization and auditory enhancement

Smith¹,

Lombard²,

Shaba³

2012

Work

View full text Add to dashboard Cite

Accurate sound source localization has advantages for the performance of work by humans. The ability to accurately localize sound sources contributes to perception, decision making and task performance. Two studies were conducted to investigate the prevalence of accurate sound source localization and the enhancement that spatially separated sound source locations can have on speech perception. The first study was conducted to characterize the ability to detect the location of horizontal plane sound sources. A sample of 117 participants with the hearing capacity within the normal limits participated in the study. The results indicated that sound sources located towards the front of the participant were identified more frequently than those sound sources located towards the rear positions. Based on the results found in the first study, a second study was conducted to assess performance within a listening task. Three different spatial configurations were used to assess if similar trends in performance translated to sound sources through headphones. Fifteen research participants performed a Coordinated Response Measure (CRM) task requiring the identification of a speech phrase and its associated information for a diotic configuration and two different spatial sound source configurations. Performance measured for the diotic configuration was significantly (p0.05) less than for the two spatial configurations. The current studies indicate distinct advantages of utilizing localized sound sources to present auditory signal and speech to listeners.

show abstract

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Horizontal plane sound source localization and auditory enhancement

Smith¹,

Lombard²,

Shaba³

2012

Work

View full text Add to dashboard Cite

show abstract

“…Any data group can be mapped to a sound group of type both. We based this decision on work done by Ahmad et al [1], who proposed that instant-based temporal information (in our case 'instant' sounds) are used to specify a point in time, where as interval-based temporal information ('interval' sounds) are used to indicate status or progress.…”

Section: Policymentioning

confidence: 99%

A Model for Data-Driven Sonification Using Soundscapes

Wolf

Gliner

Fiebrink

2015

Companion Proceedings of the 20th International Conference on Intelligent User Interfaces

View full text Add to dashboard Cite

A sonification is a rendering of audio in response to data, and is used in instances where visual representations of data are impossible, difficult, or unwanted. Designing sonifications often requires knowledge in multiple areas as well as an understanding of how the end users will use the system. This makes it an ideal candidate for end-user development where the user plays a role in the creation of the design. We present a model for sonification that utilizes user-specified examples and data to generate cross-domain mappings from data to sound. As a novel contribution we utilize soundscapes (acoustic scenes) for these user-selected examples to define a structure for the sonification. We demonstrate a proof of concept of our model using sound examples and discuss how we plan to build on this work in the future.

show abstract

“…Utilizing current auditory display design principles based on perceptual and theoretical findings covered in Bregman's (1990) Auditory Scene Analysis and theoretical models that focus on integrating sound in interactive interfaces (Ahmad, Stanney, & Fouad, 2009), our aim was to develop an auditory display that improves head-up monitoring of an aircraft's position relative to a flight plan. We employed the audio integration, temporal audio, and spatial audio theoretical models defined by Ahmad et al (2009) as guidelines for determining the cognitive performance objectives and subsequent acoustic wave attributes for each auditory cue.…”

Section: Introductionmentioning

confidence: 99%

“…We employed the audio integration, temporal audio, and spatial audio theoretical models defined by Ahmad et al (2009) as guidelines for determining the cognitive performance objectives and subsequent acoustic wave attributes for each auditory cue. Auditory cues were used to guide psychomotor activity when adjustments were being made to the aircraft's control yoke to correct and maintain accurate flight navigation.…”

Section: Introductionmentioning

confidence: 99%

Enabling the effective application of spatial auditory displays in modern flight decks

Towers¹

View full text Add to dashboard Cite

Modern aircraft are fitted with sophisticated technologies that support or fully automate tasks that were once performed solely by the pilot. This means that pilots now spend much of their time monitoring instruments and managing the automation rather than manually manipulating flight controls. While modern flight decks are extremely safe, pilots do occasionally experience high visual workload conditions that may degrade their ability to effectively monitor flight instruments. This thesis describes the design and evaluation of spatial auditory displays that are intended to improve a pilot's ability to monitor flight deck instruments under conditions of high visual workload. The aims broadly focus on developing design features that enable a pilot to perform head-up monitoring of an aircraft's navigation readouts while concurrently attending to verbal dialogue.

show abstract

Theoretical foundations for integrating sound in interactive interfaces: identifying temporal and spatial information conveyance principles

Cited by 5 publications

References 47 publications

Horizontal plane sound source localization and auditory enhancement

Horizontal plane sound source localization and auditory enhancement

A Model for Data-Driven Sonification Using Soundscapes

Enabling the effective application of spatial auditory displays in modern flight decks

Contact Info

Product

Resources

About