Reciprocity and Retaliation in Social Games With Adaptive Agents

Asher, Derrik E.; Zaldivar, Andrew; Barton, Brian; Brewer, Alyssa A.; Krichmar, Jeffrey L.

doi:10.1109/tamd.2012.2202658

Cited by 18 publications

(26 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, it has been difficult to find empirical evidence supporting these roles for tonic and phasic neuromodulation. Our prior modeling has shown that direct opponency between these systems is not necessary to achieve behavioral opponency (Asher et al, 2010, 2012; Zaldivar et al, 2010). In many cases there is an environmental tradeoff between the expected rewards and costs, and this can lead to opponency between active reward-seeking and withdrawn behavior.…”

Section: Discussionmentioning

confidence: 99%

“…Empirical evidence and theoretical modeling have suggested that the mPFC, the anterior cingulate cortex, and the OFC control decision-making in the face of reward-cost tradeoffs (Rudebeck et al, 2006; Rushworth et al, 2007; Chelian et al, 2012). That is, the OFC's interaction with the DA system is monitoring the expected reward of an action, and the mPFC's interaction with the 5-HT system is monitoring the expected cost of an action (Zaldivar et al, 2010; Asher et al, 2012). …”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior

Krichmar¹

2013

Front. Neurorobot.

View full text Add to dashboard Cite

The vertebrate neuromodulatory systems are critical for appropriate value-laden responses to environmental challenges. Whereas changes in the overall level of dopamine (DA) have an effect on the organism's reward or curiosity-seeking behavior, changes in the level of serotonin (5-HT) can affect its level of anxiety or harm aversion. Moreover, top-down signals from frontal cortex can exert cognitive control on these neuromodulatory systems. The cholinergic (ACh) and noradrenergic (NE) systems affect the ability to filter out noise and irrelevant events. We introduce a neural network for action selection that is based on these principles of neuromodulatory systems. The algorithm tested the hypothesis that high levels of serotonin lead to withdrawn behavior by suppressing DA action and that high levels of DA or low levels of 5-HT lead to curious, exploratory behavior. Furthermore, the algorithm tested the idea that top-down signals from the frontal cortex to neuromodulatory areas are critical for an organism to cope with both stressful and novel events. The neural network was implemented on an autonomous robot and tested in an open-field paradigm. The open-field test is often used to test for models anxiety or exploratory behavior in the rodent and allows for qualitative comparisons with the neurorobot's behavior. The present neurorobotic experiments can lead to a better understanding of how neuromodulatory signaling affects the balance between anxious and curious behavior. Therefore, this experimental paradigm may also be informative in exploring a wide range of neurological diseases such as anxiety, autism, attention deficit disorders, and obsessive-compulsive disorders.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior

Krichmar¹

2013

Front. Neurorobot.

View full text Add to dashboard Cite

show abstract

“…The association between tonic/phasic neuromodulation and explore/exploit behavior was originally put forth by Aston-Jones and Cohen (2005) based on their observations of the noradrenergic system during studies with awake-behaving monkeys. Based on this and other empirical evidence, we have extended the exploration/exploitation idea to other neuromodulatory systems ( Asher et al, 2010 , 2012a ; Zaldivar et al, 2010 ; Krichmar, 2013 ). Specifically, tonic levels of neuromodulation have been associated with distractible behavior and poor task performance, whereas phasic neuromodulation has been associated with attentiveness and good task performance ( Aston-Jones and Cohen, 2005 ).…”

Section: A Multidisciplinary Paradigm To Investigate the Serotonergicmentioning

confidence: 99%

A dynamic, embodied paradigm to investigate the role of serotonin in decision-making

Asher¹,

Craig²,

Zaldivar³

et al. 2013

Front. Integr. Neurosci.

View full text Add to dashboard Cite

Serotonin (5-HT) is a neuromodulator that has been attributed to cost assessment and harm aversion. In this review, we look at the role 5-HT plays in making decisions when subjects are faced with potential harmful or costly outcomes. We review approaches for examining the serotonergic system in decision-making. We introduce our group’s paradigm used to investigate how 5-HT affects decision-making. In particular, our paradigm combines techniques from computational neuroscience, socioeconomic game theory, human–robot interaction, and Bayesian statistics. We will highlight key findings from our previous studies utilizing this paradigm, which helped expand our understanding of 5-HT’s effect on decision-making in relation to cost assessment. Lastly, we propose a cyclic multidisciplinary approach that may aid in addressing the complexity of exploring 5-HT and decision-making by iteratively updating our assumptions and models of the serotonergic system through exhaustive experimentation.

show abstract

“…Moreover, various types of agents have been used in games generally for a wide range of purposes, e.g. emotional game agent architectures (Spraragen and Madni 2014), agent-centric game design methodologies (Dignum et al 2009), memetic computing within games (Miche et al 2015), and adaptive agents in social games (Asher et al 2012). Galway et al (2008) extensively survey machine learning within digital games (neural networks, evolutionary computation, and reinforcement learning for game agent control), which provides a means to improve the behavioural dynamics of game agents by facilitating the automated generation and selection of behaviours according to the behaviour or playing style of the player.…”

Section: Levels Of Personalisation In Collaborative Gamesmentioning

confidence: 99%

Reflective agents for personalisation in collaborative games

2018

View full text Add to dashboard Cite

The collaborative aspect of games has been shown to potentially increase player performance and engagement over time. However, collaborating players need to perform well for the team as a whole to benefit and thus teams often end up performing no better than a strong player would have performed individually. Personalisation offers a means for improving overall performance and engagement, but in collaborative games, personalisation is seldom implemented, and when it is, it is overwhelmingly passive such that the player is not guided to goal states and the effectiveness of the personalisation is not evaluated and adapted accordingly. In this paper, we propose and apply the use of reflective agents to personalisation ('reflective personalisation') in collaborative gaming for individual players within collaborative teams via a combination of individual player and team profiling in order to improve player and thus team performance and engagement. The reflective agents self-evaluate, dynamically adapting their personalisation techniques to most effectively guide players towards specific goal states, match players and form teams. We incorporate this agent-based approach within a microservices architecture, which itself is a set of collaborating services, to facilitate a scalable and portable approach that enables both player and team profiles to persist across multiple games. An experiment involving 90 players over a two-month period was used to comparatively assess three versions of a collaborative game that implemented reflective, guided, and passive personalisation for individual players within teams. Our results suggest that the proposed reflective personalisation approach improves team player performance and engagement within collaborative games over guided or passive personalisation approaches, but that it is especially effective for improving engagement.

show abstract

Reciprocity and Retaliation in Social Games With Adaptive Agents

Cited by 18 publications

References 41 publications

A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior

A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior

A dynamic, embodied paradigm to investigate the role of serotonin in decision-making

Reflective agents for personalisation in collaborative games

Contact Info

Product

Resources

About