Gist Trace-based Learning: Efficient Convention Emergence from Multilateral Interactions

The concept of conventions has attracted much attention in the multi-agent system research. In this article, we study the emergence of conventions from repeated n -player coordination games. Distributed agents learn their policies independently and are capable of observing their neighbours in a network topology. We distinguish two types of information representation about the observations: gist trace and verbatim trace. We conjecture that learning based on the gist trace, which overlooks the details and focuses only on the general choice of action of a neighbourhood, should achieve efficient convention emergence. To this end, a novel learning method that makes use of the gist trace is proposed. The experimental results confirm that the proposed method establishes conventions much faster than the state-of-the-art learning methods across diverse settings of multi-agent systems. In particular, the use of gist trace derived at a low level of abstraction further improves the efficiency of convention emergence.

Authors

• Shuyue Hu Shanghai Artificial Intelligence Laboratory
• Chin-wing Leung University of Warwick
• Ho-fung Leung Independent Researcher
• Jiamou Liu The University of Auckland

Keywords

No keywords are indexed for this paper.