Distributed processing of side-choice biases

Treviño, Mario; León, Ricardo Medina-Coss y

doi:10.1016/j.brainres.2020.147138

Cited by 2 publications

(1 citation statement)

References 52 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although mostly overlooked as part of models of value-based learning, constant bias has occasionally been reported-with and without laterality [12,[14][15][16][17]21,91,[94][95][96][97][98][99] as well as between acting and not acting for a go/no-go task [100][101][102][103][104][105]. Even decision making that is not defined by learning-whether value-based [106] or perceptual [80,86,[88][89][90]92,[107][108][109][110][111][112]-can be affected by such stimulus-independent biases with a less obvious role for bias than would be assumed for skillful action-based decision making where physical aspects of action per se have explicit relevance [113].…”

Section: Constant Bias and Lateral Biasmentioning

confidence: 99%

Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts

Colas,

O’Doherty,

Grafton

2024

PLoS Comput Biol

View full text Add to dashboard Cite

Active reinforcement learning enables dynamic prediction and control, where one should not only maximize rewards but also minimize costs such as of inference, decisions, actions, and time. For an embodied agent such as a human, decisions are also shaped by physical aspects of actions. Beyond the effects of reward outcomes on learning processes, to what extent can modeling of behavior in a reinforcement-learning task be complicated by other sources of variance in sequential action choices? What of the effects of action bias (for actions per se) and action hysteresis determined by the history of actions chosen previously? The present study addressed these questions with incremental assembly of models for the sequential choice data from a task with hierarchical structure for additional complexity in learning. With systematic comparison and falsification of computational models, human choices were tested for signatures of parallel modules representing not only an enhanced form of generalized reinforcement learning but also action bias and hysteresis. We found evidence for substantial differences in bias and hysteresis across participants—even comparable in magnitude to the individual differences in learning. Individuals who did not learn well revealed the greatest biases, but those who did learn accurately were also significantly biased. The direction of hysteresis varied among individuals as repetition or, more commonly, alternation biases persisting from multiple previous actions. Considering that these actions were button presses with trivial motor demands, the idiosyncratic forces biasing sequences of action choices were robust enough to suggest ubiquity across individuals and across tasks requiring various actions. In light of how bias and hysteresis function as a heuristic for efficient control that adapts to uncertainty or low motivation by minimizing the cost of effort, these phenomena broaden the consilient theory of a mixture of experts to encompass a mixture of expert and nonexpert controllers of behavior.

show abstract