Cognitive effects of prolonged continuous human-machine interaction: The case for mental state-based adaptive interfaces

Abstract

Operators of complex systems across multiple domains (e.g., aviation, automotive, and nuclear power industry) are required to perform their tasks over prolonged and continuous periods of time. Mental fatigue as well as reduced cognitive flexibility, attention, and situational awareness all result from prolonged continuous use, putting at risk the safety and efficiency of complex operations. Mental state-based adaptive systems may be a solution to this problem. These systems infer the current mental state of an operator based on a selection of metrics ranging from operator independent measures (e.g., weather and time of day), to behavioral (e.g., reaction time and lane deviation) as well as physiological markers (e.g., electroencephalography and cardiac activity). The interaction between operator and system may then be adapted in one of many ways to mitigate any detected degraded cognitive state, thereby ensuring continued safety and efficiency. Depending on the task at hand and its specific problems, possible adaptations -usually based on machine learning estimations- e.g., include modifications of information, presentation modality or stimuli salience, as well as task scheduling. Research on adaptive systems is at the interface of several domains, including neuroergonomics, human factors, and human-computer interaction in an applied and ecological context, necessitating careful consideration of each of the aforementioned aspects. This article provides an overview of some of the key questions and aspects to be considered by researchers for the design of mental state-based adaptive systems, while also promoting their application during prolonged continuous use to pave the way toward safer and more efficient human-machine interaction.

How the Quantity and Hue Contrast of Interface Color Coding Affect Human Perception: Evidence from Two EEG Studies

“…These ndings offered a neuroergonomics reference for interface color coding as well as contributed to uncovering brain mechanisms of color perception. In recent years, numerous researchers have employed neurometric methods to examine the cognitive activity occurring during interaction with interfaces in order to achieve optimal ergonomics [90,91]. We suggested that in addition to high levels of cognitive activity, the perceptual process is also worthy of interest, not only due to its direct impact on user experience but to its interaction with cognition.…”

An empirical investigation into the preferences of the elderly for user interface design in personal electronic health record systems

“…The rise of the HCI field emphasizes the connection between users and machines, primarily allowing participants in computer operations to exchange information. Existing system interfaces are generally designed to interact with a wide array of public users ( 19 ). But many systems have not been able to bring about a significant improvement in healthcare services due to issues such as poor usability or inadequate management ( 20 , 21 ).…”

Sequence Compression and Alignment-Based Process Alarm Prediction

“…11 The main contribution of a state-based alarm system is that long-lasting 12 and nuisance 13 alarms can be removed; this way the workload of the operators can be lowered 14 to reduce their mental fatigue. 15 These kinds of systems are supported by machine learning algorithms to recognize alarm situations and to predict possible future scenarios by using probability values. 16 Usual state-based alarm systems need expert knowledge and first principles based on this knowledge.…”

“…With the help of the proposed method, the process control system can be transformed into a so-called state-based alarm system . The main contribution of a state-based alarm system is that long-lasting and nuisance alarms can be removed; this way the workload of the operators can be lowered to reduce their mental fatigue . These kinds of systems are supported by machine learning algorithms to recognize alarm situations and to predict possible future scenarios by using probability values .…”