Heuristics From Bounded Meta-Learned Inference

Abstract

Numerous researchers have put forward heuristics as models of human decision making. However, where such heuristics come from is still a topic of ongoing debates. In this work we propose a novel computational model that advances our understanding of heuristic decision making by explaining how different heuristics are discovered and how they are selected. This model, called bounded meta-learned inference, is based on the idea that people make environment-specific inferences about which strategies to use, while being efficient in terms of how they use computational resources. We show that our approach discovers two previously suggested types of heuristics -- one reason decision making and equal weighting -- in specific environments. Furthermore, the model provides clear and precise predictions about when each heuristic should be applied: knowing the correct ranking of attributes leads to one reason decision making, knowing the directions of the attributes leads to equal weighting, and not knowing about either leads to strategies that use weighted combinations of multiple attributes. This allows us to gain new insights on mixed results of prior empirical work on heuristic decision making. In three empirical paired comparison studies with continuous features, we verify predictions of our theory, and show that it captures several characteristics of human decision making not explained by alternative theories.

Monkey Plays Pac-Man with Compositional Strategies and Hierarchical Decision-making

“…Finally, the model, without being specified so, revealed that a single strategy dominates monkeys' decision-making during most of the game. This is consistent with the idea that the strategy-using as the method that the brain uses to simplify decision making by ignoring irrelevant game aspects to solve complex tasks (Binz et al, 2020;Moreno-Bote et al, 2020).…”

Filling the gaps: Cognitive control as a critical lens for understanding mechanisms of value-based decision-making

“…To achieve this, future work would benefit from studying a greater variety of choice contexts that considers the cognitive resources and cognitive flexibility that decision-makers have at their disposal. It remains unclear how the brain decides whether to compute and compare value (and/or how precisely) versus using a simplifying approach to generating a choice (Hayden & Niv, 2021), nor what the underlying computations and neural value correlates of simplified choice strategies are (Binz, Gershman, Schulz, & Endres, 2020;Dayan, 2012). Decision-makers could, for instance, rely on memory to retrieve previous solutions rather than recomputing value and comparison each time (Dasgupta & Gershman, 2021), or they could have heuristics such as always choosing certain options if they are part of the set (e.g.…”

Optimal Metacognitive Control of Memory Recall

“…Although we identified the shape of this optimal boundary with computationally intensive, model-based methods, it could be well-approximated by simple modelfree learning mechanisms. Understanding how people learn effective metacognitive strategies is a subject of ongoing research (Binz, Gershman, Schulz, & Endres, 2022;Callaway, Jain, et al, 2022;He & Lieder, 2022;Jain et al, 2019;Lieder et al, 2018).…”