Multi-Modal Cockpit Warnings: Pictures. Words. or Both?

Abstract

This paper examines the requirement for, and benefits of, multi-modal information presentation in cockpit warning systems. It also attempts to provide an account of the nature and levels of processing involved when information from one source is integrated with a supposedly redundant additional source to provide a performance gain in choice reaction time (RT) tasks, and its applicability to other cockpit systems. An experiment is described which used warning/caution ‘icons’ (pictorial representations of danger situations) and verbal warning messages, both singly and in combination. The visual icons were generated by RAF aircrew, using an iterative design process, as being meaningful pictorial representations of real-world warnings. Subjects were required to identify whether the situations presented warnings i.e. high priority/immediate action or cautions i.e. low priority/immediate awareness. The results obtained showed a significant decrease in response latencies when correlated bi-modal information was given as compared to the uni-modal conditions. The high level of abstraction of these icons strongly implied that the performance gains occurring must be as the result of the integration of ‘information’ rather than ‘data’. Subjective Situational Awareness Rating Technique (SART) scores also showed that benefits may also be accrued through reduced workload and increased depth of understanding. The results of these experiments are considered in terms of current Information Processing and Neural Network theories and an attempt to provide a cognitive model of this integrality effect is also described.

Do You Need to Travel? Mapping Face-to-Face Communication Objectives to Technology Affordances

“…Shared situation awareness refers to participants' shared understanding of the environment (Endsley, 1988). Here we will assess the instructor and apprentice's shared situation awareness using the condensed 3D-SART (Situation Awareness Rating Technique; Selcon et al, 1992). This scale involves a global assessment of the demands on attentional resources, the supply of attentional resources, and an understanding of the situation from low (0) to high (100).…”

Driver Take-Over Reaction in Autonomous Vehicles with Rotatable Seats

“…After each condition, situation awareness was measured using 3D-SART [24], which has a total of three questions. Automation trust was measured using the overall average score from the questionnaire developed by Bisantz and Seong [25] with a total of 12 questions.…”

Human/machine interface modalities for soldier systems technologies

“…There exists a considerable body of research illustrating the benefits of augmenting primary modalities with others for the presentation of task-relevant information. For example, it has been found Aat adding 3D localized audio improves target acquisition performance in flight simulation tasks relative to visual-only cueing (Bolia et al, 1999), Along similar lines, Selcon, Taylor, and Shadrake (1992) explored the potential of multi-modal cockpit wamings. They conducted an experiment in ^ich waming/caution visual icons and verbal waming messages were used singly and in combination to alert subjects to danger situations.…”

“…There have been a number of efforts addressing the potential of multimodal interfaces in cockpits. Selcon, Taylor, and Shadrake (1992) conducted an experiment in which visual warning icons and verbal warning messages were used singly and in combination. Results showed significantly faster response times when bimodal warnings were given as compared to either unimodal alert.…”