3-D Audio in the Fighter Cockpit Improves Task Performance

Abstract

A flight simulator experiment was conducted to explore the benefits of a virtual 3-D audio display to support in-cockpit tasks regarding performance and workload. In half of the conditions, one or two tasks requiring information from a head-down display (HDD) were supported by 3-D audio. The performance on several tasks improved when 3-D audio was present, whereas no negative performance effects were foimd. Furthermore, the frequency of eye movements to the HDD was reduced more than 50% in all 3-D audio conditions. Physiological measures were not affected, indicating that mental effort was the same in all conditions. Only a small reduction in subjective workload in some 3-D audio conditions was observed. Pilots were also able to process the information from two independent 3-D auditory displays that were present at the same time. The results show that pilots can perform flight and in-cockpit tasks more efficiently when they are supported by 3-D audio. wordsRequests for reprints should be sent to Hans Veltman, TNO Human Factors,

Improving 3-D Audio Localisation Through the Provision of Supplementary Spatial Audio Cues

“…Wickens' Multiple Resource Theory [19] suggests that by diversifying the modality of presentation, independent sensory and cognitive processing channels may be more effectively employed, thereby accommodating otherwise potentially excessive workload demands. Several studies claim that multisensory displays improve dual-task performance and increase sensory perception [20][21][22], while often facilitating more immersive situation awareness [23,24]. Multisensory displays may benefit form this research as it attempts to enable the cost-effective use of spatial sonification, which may be useful when presenting information relating to psychomotor activity and the monitoring of discrete variables such as distance or error.…”

Concurrent 3-D Sonifications Enable the Head-Up Monitoring of Two Interrelated Aircraft Navigation Instruments

“…More advanced three-dimensional audio in the form of verbal beacons, broadband cuing signals, and sonifications has been used to supplement traffic collision avoidance and target acquisition and tracking guidance systems within cockpits (Begault & Pittman, 1996;McAnally & Martin, 2008;Tannen, Nelson, Bolia, Warm, & Dember, 2004;Veltman, Oving, & Bronkhorst, 2004a). Veltman, Oving, and Bronkhorst (2004b) successfully encoded aircraft roll angle corrections into the pulse frequency and pitch of a spatially positioned tone in order to improve pilot performance during a fighter pursuit task. Simpson et al (2005) also successfully utilized an auditory display to indicate waypoint direction through the use of a white noise beacon.…”

Memory for the locations of environmental sounds

“…In both experiments, sounds were presented from a wide range of azimuths and elevations in virtual auditory space (VAS) via individualized displays. VAS displays were utilized because they provided us with a convenient means of presenting sounds from multiple locations, and the application of these displays in real-world environments in which spatial information needs to be conveyed to human operators is increasingly being advocated (e.g., Begault, 1993;McKinley et al, 1994;Parker et al, 2004;Veltman et al, 2004). The potential use of VAS displays to help humans maintain spatial awareness was a primary motivator for this study, as the ability of operators to keep track of the locations of multiple sources of sound will need to be known for VAS displays to be effective for this purpose.…”