Human performance measures for the evaluation of process control human-system interfaces in high-fidelity simulations

Abstract

We reviewed the available literature on measuring human performance to evaluate human-system interfaces (HSIs), focused on high-fidelity simulations of industrial process control systems, to identify best practices and future directions for research and operations. We searched the available literature and then conducted in-depth review, structured coding, and analysis of 49 articles, which described 42 studies. Human performance measures were classified across six dimensions: task performance, workload, situation awareness, teamwork/collaboration, plant performance, and other cognitive performance indicators. Many studies measured performance in more than one dimension, but few studies addressed more than three dimensions. Only a few measures demonstrated acceptable levels of reliability, validity, and sensitivity in the reviewed studies in this research domain. More research is required to assess the measurement qualities of the commonly used measures. The results can provide guidance to direct future research and practice for human performance measurement in process control HSI design and deployment.

Optimising the future of technology in organisations: A human factors perspective

“…For example, an experienced driver who observes the illumination of brake lights in preceding vehicles will immediately initiate a deceleration commensurate with the perceived deceleration of these vehicles. This suggests that there is a level of sustained attention afforded by continuous engagement with a system that facilitates timely situation assessment which, in turn prompts decision-making (Xu et al, 2018).…”

Single mission workload and influencing factors in German prehospital emergency medicine - a nationwide prospective survey of 1361emergency missions

“…The net decrease in workload seems small at a first glance, but it should be kept in mind that teamwork scores were very high and with little variance, suggesting a ceiling effect in the relationship of teamwork and workload. In other terms: Teamwork was so consistently good that effects on workload are seemingly smaller than the importance of the relationship might deserve [17].…”

Augmented Reality for the enhancement of space product assurance and safety

“…The majority of respondents were male (47), with only nine female participants -a distortion that can be explained with the population sampled. Of the contributors, four were in the age bracket [30][31][32][33][34][35][36][37][38][39]20 in 40-49, 26 in the bracket of 50-59, and five over 60, again a distortion that is normal for the target group. After responding to the online survey, participants were offered to participate in a follow-up phone interview (see Appendix C).…”

“…The selection of the display technology is non-trivial given its potential influence on overall system performance and safety, which is particularly important in high-risk and high-consequence industries, as discussed by Xua, Anders et al [32]. On this regard, the requirements for an immersive AR system including sensing, registration and display must be derived from a holistic human factors approach [33].…”