Cognitive ergonomics for data analysis. Experimental study of cognitive limitations in a data-based judgement task

Abstract

Today's ever-increasing amount of data places new demands on cognitive ergonomics and requires new design ideas to ensure successful human-data interaction. Our aim was to identify the cognitive factors that must be considered when designing systems to improve decision-making based on large amounts of data. We constructed a task that simulates the typical cognitive demands people encounter in data analysis situations. We demonstrate some essential cognitive limitations using a behavioural experiment with 20 participants. The studied task presented the participants with critical and noncritical attributes that contained information on two groups of people. They had to select the response option (group) with the higher level of critical attributes. The results showed that accuracy of judgement decreased as the amount of information increased, and that judgement was affected by irrelevant information. Our results thus demonstrate critical cognitive limitations when people utilise data and suggest a cognitive bias in data-based decision-making. Therefore, when designing for cognition, we should consider the human cognitive limitations that are manifested in a data analysis context. Furthermore, we need general cognitive ergonomic guidelines for design that support the utilisation of data and improve data-based decision-making.

Is Artificial Intelligence Ready to Assess an Enterprise’s Financial Security?

“…In addition, the need for some types of enterprises to monitor their financial position every second indicates financial security analysis based on economic analysis using, for example, financial statements prepared once per reporting period, is insufficient. In addition, when presenting data in numeric or visual format, it is rarely possible to simultaneously present all information as a whole (Kalakoski et al 2019). That is, an important element of managing a company's financial security is an objective and early determination of its level, which cannot be done without a comprehensive analysis of both the company's financial and non-financial indicators.…”

“…This position is consistent with the assertions of scientists studying data analysis with regard to human cognitive limitations, which rightly indicate 'the amount of data has increased and the methods for analyzing them have advanced considerably in recent years, the basic cognitive ability of human beings has not developed in the same way'. In addition, 'developing expert-level knowledge and skills is time-consuming and we seldom acquire exceptional or even adequate skill levels in a wide range of domains' (Kalakoski et al 2019). Moreover, even when using decision support systems, decisions do not become the most optimal (Arnott 2005;Phillips-Wren et al 2019).…”

A Systematic Review of Cognitive Ergonomics And Safety: General Trends And Application Areas

“…Human cognitive limits should be taken into account when designing cognitive processes. Cognitive ergonomic guidelines that facilitate data-based decision-making should be used [220].…”