Multimodal Threat Cueing in Simulated Combat Vehicle

Abstract

We investigated three types of display combinations for threat cueing in a simulated combat vehicle. The display combinations consisted of two bimodal combinations, a visual head-up display (HUD) combined with 3D audio; a tactile torso belt combined with 3D audio; and a multimodal combination, the HUD, tactile belt, and 3D audio combined. The participant's main task was to as fast as possible align the heading of the combat vehicle with the displayed direction to a threat. To increase general task difficulty and provide a secondary measure of mental workload, the participant also was required to identify radio calls. Threat localization accuracy was highest and reaction time shortest with the use of both the HUD combined with 3D audio and with the multimodal display. Subjective ratings of perception of initial threat direction were most positive for both the tactile belt combined with 3D audio and for the multimodal display. The ratings of perceived threat direction at the final phase of threat alignment, however, were most positive for the HUD combined with 3D audio and for the multimodal display. Thus, the multimodal display with HUD, tactile belt, and 3D audio combined proved to be beneficial for all measures.

Enhanced Perception and Performance by Multimodal Threat Cueing in Simulated Combat Vehicle

“…The Swedish National Road and Transport Research Institute and the Swedish Defence Research Agency funded work on this article. Experiment 1 was presented at Human-Computer Interaction International 2007 (Carlander, Eriksson, & Oskarsson, 2007), and Experiment 2 was presented at the 2008 Human Factors and Ergonomics Society annual meeting (Oskarsson, Eriksson, Lif, Lindahl, & Hedström, 2008). We gratefully acknowledge the reviewers and the editor for invaluable comments and suggestions for improvements.…”

Tactile Torso Display For Fighter Pilots – Wing-Oriented And Horizon-Oriented Presentation

“…Tactile displays offer near silent and dark operation, relevant during covert missions for dismounted soldiers. Tactile displays have been used in experiments and field tests at FOI and Saab with promising results Oskarsson, Eriksson, Lif, Lindahl, & Hedström, 2008;Self, van Erp, Eriksson & Elliott, 2008). In other experiments performance with tactile displays has been compared to using visual and 3D audio displays, and multimodal combinations Eriksson, van Erp, Carlander, Levin, van Veen, & Veltman, 2008;Lif, Oskarsson, Lindahl, Hedström & Svensson, 2011).…”

Augmented Reality-based Graphics Application to Assist Children with Autism Spectrum Disorder

“…The role and importance of visual, auditory, and tactile cueing in designing augmented environments has been highlighted by many notable works (Angelopoulos, 2018;Janssen, Steveninck, Salim, Bloem, Heida, & Wezel, 2020;Miller, Cooper, & Szoboszlay, 2019;Pangilinan, Lukas, & Mohan, 2019). Visual, auditory, and tactile cues need to be given meticulous consideration in the design process since simultaneous presentation of so much information to the participant all at once without careful consideration can in-fact increase the cognitive overload and can adversely affect the learning process (Oskarsson, Eriksson, Lif, Lindahl, & Hedström, 2008).…”