An Overview of Opponent Modeling for Multi-agent Competition

Liu, Lu; Yang, Jie; Zhang, Yaoyuan; Zhang, Jingci; Ma, Yuxi

doi:10.1007/978-3-031-20096-0_48

Cited by 1 publication

(1 citation statement)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Existing opponent modeling methods [12,15] focus mainly on modeling the actions, types, preferences, and beliefs of opponents. In action modeling [16][17][18], an opponent's future actions are predicted by explicitly reconstructing the opponent's decision-making method, such as the action frequency.…”

Section: Introductionmentioning

confidence: 99%

Improving Agent Decision Payoffs via a New Framework of Opponent Modeling

et al. 2023

View full text Add to dashboard Cite

The payoff of an agent depends on both the environment and the actions of other agents. Thus, the ability to model and predict the strategies and behaviors of other agents in an interactive decision-making scenario is one of the core functionalities in intelligent systems. State-of-the-art methods for opponent modeling mainly use an explicit model of opponents’ actions, preferences, targets, etc., that the primary agent uses to make decisions. It is more important for an agent to increase its payoff than to accurately predict opponents’ behavior. Therefore, we propose a framework synchronizing the opponent modeling and decision making of the primary agent by incorporating opponent modeling into reinforcement learning. For interactive decisions, the payoff depends not only on the behavioral characteristics of the opponent but also the current state. However, confounding the two obscures the effects of state and action, which then cannot be accurately encoded. To this end, state evaluation is separated from action evaluation in our model. The experimental results from two game environments, a simulated soccer game and a real game called quiz bowl, show that the introduction of opponent modeling can effectively improve decision payoffs. In addition, the proposed framework for opponent modeling outperforms benchmark models.

show abstract