Decision support and vulnerability to interruption in a dynamic multitasking environment

Abstract

Using a microworld simulation of maritime decision making, we compared two decision support systems (DSS) in their impact upon recovery from interruption. The Temporal Overview Display (TOD) and Change History Table (CHT) -designed to support temporal awareness and change detection, respectively -have previously proven useful in improving situation awareness; however, evaluation of support tools for multitasking environments should not be limited to the specific aspects of the task that they were designed to augment. Using a combination of performance, self-report, and eye-tracking measures, we find that both DSS counter-intuitively have a negative effect on performance. Resumption lags are increased, elevated post-interruption decision-making times persist for longer, and defensive effectiveness is impaired relative to No-DSS. Eye-tracking measures indicate that in the baseline condition, participants tend to encode the visual display more broadly, where as those in the two DSS conditions may have experienced a degree of attentional tunnelling due to high workload. We suggest that for a support tool to be beneficial it should ease the burden on attentional resources so that these can be used for reconstructing a mental model of the post-interruption scene.

Home is Where the Lab is: A Comparison of Online and Lab Data From a Time-sensitive Study of Interruption

“…However, the domain of interruptions and multitasking is large and multifaceted. There is a clear dichotomy between routine tasks like the one presented in this study and problem solving tasks that have also been investigated (Hodgetts & Jones, 2006;Hodgetts, Tremblay, Vallières, & Vachon, 2015; P. L. Morgan & Patrick, 2013). Problem solving tasks require participants to be attentive and have a strong conceptual understanding of the problem they are trying to solve.…”

Multitasking in the military: Cognitive consequences and potential solutions

“…Unfortunately, few military domains currently incorporate multitasking assessment in their personnel selection process. Further, although multitasking training is not common in all military domains, some platforms currently exist that allow training to be adapted to the relevant context (Hodgetts et al, ; Kylesten & Nählinder, ). Mitchell and Driskell () have suggested that studies using job analyses could identify specific task requirements and cognitive skills needed to perform them.…”

“…Interruptions are also characteristic of demanding C2 operator work environments, which are dynamic and often involve situations that require frequent updates to colleagues or superiors (Hodgetts, Tremblay, Vallières, & Vachon, ). Because the main tasks of C2 operators are frequently changing, situational awareness tends to be limited, especially if changes occur when the operator's attention is directed toward another task and is therefore less likely to be noticed (Smallman & St. John, ; St. John & Smallman, ).…”

“…Another effective way to train multitasking abilities is through high‐fidelity simulations (e.g., microworlds) or using gaming platforms. Indeed, such platforms can capture the characteristics of multitasking environments (Hodgetts et al, ) and allow the user to learn appropriate behaviors transferrable to future training or real‐world situations (e.g., Kylesten & Nählinder, ).…”

Teamwork evaluation with a microworld platform

“…By providing some level of control, microworlds may help to uncover generalizable causal interpretations necessary to validate theory. As in the case of any technology and/or new practice introduction, impact assessment it will be more realistically evaluated closer to the very often multitasking environment in which it will take place instead of the solo foci on the specific intervention [13].…”