Attention aware systems: Theories, applications, and research agenda

Abstract

Human perceptual and cognitive abilities are limited resources. Attention is the mechanism used to allocate such resources in the most effective way. Current technologies, in addition to allowing fast access to information and people, should be designed to support human attentional processes on which they impose further strain. This paper analyses the issues related to the design of systems capable of such support: attention aware systems. We introduce the research aimed at understanding and modelling human attentional processes, including perceptual and cognitive processes as studied in cognitive psychology, as well as rhetorical, aesthetic, and social aspects related to attentional mechanisms. We analyse current approaches to the design of attention aware systems along three major features: detection of user's current attentional state, detection and evaluation of possible alternative attentional states, strategies for focus switch or maintenance. Finally, we discuss the most promising research direction for the development of systems capable of supporting human attentional mechanisms.

An Eye for the Air Traffic Controller Workload

“…Often referred to as attention aware systems, these systems are attentive to an operator's cognitive state and needs, and use the operator's gaze behavior to track and adapt the system over time (Roda and Thomas 2006). Attentive interfaces can therefore use eye movement activity to infer the user's cognitive state, anticipate operator needs, and prioritize the information presented to operators, thereby reducing attentional and cognitive workload.…”

Multimodal information presentation for high load human computer interaction

“…A user's attention can be detected by tracking gaze, gesture and head pose, and measuring physiological state (heart rate, skin conductance, etc.) and electroencephalogram (EEG) [206]. These inputs of user cognitive/attentional state will allow us to make a better use of our knowledge about the cognitive impact of presentation.…”

“…If the system is able to sense and reason about the cognitive state and attentional foci of the user at real time, it can use this input to present information in a more effective and appropriate manner. Systems that are capable of reasoning about and reacting to the user's cognitive/attentional state are called attentive user interfaces [265; 266] or attention-aware systems [206]. A user's attention can be detected by tracking gaze, gesture and head pose, and measuring physiological state (heart rate, skin conductance, etc.)…”

Real-Time Face Tracking for Attention Aware Adaptive Games

“…An attention aware system must be an adaptive system. According to [1], one of the best ways to estimate user's attention is using gaze direction. Consequently, building good adaptive attention aware system requires estimating reliably user's gaze, but in an unconstrained environment this is a very difficult task.…”

“…One of the first steps to making computer software more context aware is to make it attention aware. In [1] attention aware systems are defined as Systems capable of supporting human attentional processes.…”