Tag Mechanisms Evaluated for Coordination in Open Multi-Agent Systems

Chao, Isaac; Ardaiz, Óscar; Sangüesa, Ramón

doi:10.1007/978-3-540-87654-0_14

Cited by 8 publications

(3 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Chao et al [6] evaluate the performance of the tag mechanism with a number of learning mechanisms commonly used in the field of multi-agent system such as Generalized TFT [6], WSLS (Win stay, loose shift) [15] and basic Reinforcement Learning algorithm [8]. They conduct their evaluation using two games: PD game and Coordination game.…”

Section: Previous Workmentioning

confidence: 99%

Learning to Achieve Social Rationality Using Tag Mechanism in Repeated Interactions

Hao

Leung

2011

2011 IEEE 23rd International Conference on Tools With Artificial Intelligence

View full text Add to dashboard Cite

In multi-agent system, social rationality is a desirable goal to achieve in terms of maximizing the global efficiency of the system. Using tag to select partners in agent populations has been shown to be successful to promote social rationality among agents in prisoner's dilemma game and anticoordination game, but the results are not quite satisfactory. We develop a tag-based learning framework for a population of agents, in which each agent employs a reinforcement learning based strategy instead of using evolutionary learning as in previous works to make their decisions. We evaluate this learning framework in different games and simulation results show that better performance in terms of coordinating on socially rational outcomes can be achieved compared with that in previous work.

show abstract

Section: Previous Workmentioning

confidence: 99%

Learning to Achieve Social Rationality Using Tag Mechanism in Repeated Interactions

Hao

Leung

2011

2011 IEEE 23rd International Conference on Tools With Artificial Intelligence

View full text Add to dashboard Cite

show abstract

“…Recognizing certain attributes and characteristics of other agents before interacting with them reduces social friction (e.g., by reducing the number of unsuccessful interactions) and improves coordination. To facilitate this process, some kind of externally visible social markings are needed, for example, tag mechanisms [Chao et al 2008;Holland 1993].…”

Section: Social Instruments Reviewmentioning

confidence: 99%

Robust convention emergence in social networks through self-reinforcing structures dissolution

Villatoro

Sabater-Mir

Sen

2013

ACM Trans. Auton. Adapt. Syst.

View full text Add to dashboard Cite

Convention emergence solves the problem of choosing, in a decentralized way and among all equally beneficial conventions, the same convention for the entire population in the system for their own benefit. Our previous work has shown that reaching 100% agreement is not as straighforward as assumed by previous researchers, that, in order to save computational resources fixed the convergence rate to 90% (measuring the time it takes for 90% of the population to coordinate on the same action). In this article we present the notion of social instruments as a set of mechanisms that facilitate and accelerate the emergence of norms from repeated interactions between members of a society, only accessing local and public information and thus ensuring agents' privacy and anonymity. Specifically, we focus on two social instruments: rewiring and observation. Our main goal is to provide agents with tools that allow them to leverage their social network of interactions while effectively addressing coordination and learning problems, paying special attention to dissolving metastable subconventions.The first experimental results show that even with the usage of the proposed instruments, convergence is not accelerated or even obtained in irregular networks. This result leads us to perform an exhaustive analysis of irregular networks discovering what we have defined as Self-Reinforcing Structures (SRS). The SRS are topological configurations of nodes that promote the establishment and persistence of subconventions by producing a continuous reinforcing effect on the frontier agents. Finally, we propose a more sophisticated composed social instrument (observation + rewiring) for robust resolution of subconventions, which works by the dissolution of the stable frontiers caused by the Self-Reinforcing Substructures (SRS) within the social network.

show abstract

“…③ Tag based model Tag based model is the extension of group selection mechanism. Holland first proposed the concept of tags as markings or social cues that are attached to individuals (agents) and are observable by others [6,10]. These tags are often represented in computational models by a single number or a bit string, and they evolve like any other trait in a given evolutionary model.…”

Section: Related Workmentioning

confidence: 99%

On Evolution of Cooperative Overlay Network Based on Group Selection Mechanism

Wang

Nakao

2008

2008 the 9th International Conference for Young Computer Scientists

View full text Add to dashboard Cite

In this paper, we study the dynamic evolution of individual strategies of autonomous peers when the overlay network structure is formed by those peers. Inspired by evolutionary game, we propose general mechanism for the decentralized coordination evolution of overlay network structure, based on peers' simple local interaction, which integrates the network reciprocity and group selection mechanism, and can lead to the emergence of cooperative overlay structure. Specifically, we design the link-formation game to characterize the social dilemma of forming links in overlay network. Then, in evolution phase of each peer, we adopt simple economic concept to facilitate the evolution of overlay network into cooperative structure. Simulations clearly show the effects of various parameters, like mutation probability, the number of left peers in evolution phase and the ratio of benefit to cost, on the evolution of cooperation in overlay networks.

show abstract

Tag Mechanisms Evaluated for Coordination in Open Multi-Agent Systems

Cited by 8 publications

References 22 publications

Learning to Achieve Social Rationality Using Tag Mechanism in Repeated Interactions

Learning to Achieve Social Rationality Using Tag Mechanism in Repeated Interactions

Robust convention emergence in social networks through self-reinforcing structures dissolution

On Evolution of Cooperative Overlay Network Based on Group Selection Mechanism

Contact Info

Product

Resources

About