Predicting and Understanding Human Action Decisions during Skillful Joint-Action using Supervised Machine Learning and Explainable-AI

Abstract

This study investigated the utility of supervised machine learning (SML) and explainable artificial intelligence (AI) techniques for modeling and understanding human decision-making during multiagent task performance. Long short-term memory (LSTM) networks were trained to predict the target selection decisions of expert and novice players completing a multiagent herding task. The results revealed that the trained LSTM models could not only accurately predict the target selection decisions of expert and novice players but that these predictions could be made at timescales that preceded a player’s conscious intent. Importantly, the models were also expertise specific, in that models trained to predict the target selection decisions of experts could not accurately predict the target selection decisions of novices (and vice versa). To understand what differentiated expert and novice target selection decisions, we employed the explainable-AI technique, SHapley Additive explanation (SHAP), to identify what informational features (variables) most influenced model predictions. The SHAP analysis revealed that experts were more reliant on information about target direction of heading and the location of co-herders (i.e., other players) compared to novices. The implications and assumptions underlying the use of SML and explainable-AI techniques for investigating and understanding human decision-making are discussed.

Comparison of machine learning algorithms for evaluating building energy efficiency using big data analytics

“…Furthermore, Auletta et al, (2022) in their findings claims that human instructor's expert is used to inform the model which outputs are correct and which are not. Supervised machine learning is further classified into classification and regression.…”