Think How Your Teammates Think: Active Inference Can Benefit Decentralized Execution

In multi-agent systems, explicit cognition of teammates' decision logic serves as a critical factor in facilitating coordination. Communication (i.e., "Tell") can assist in the cognitive development process by information dissemination, yet it is inevitably subject to real-world constraints such as noise, latency, and attacks. Therefore, building the understanding of teammates' decisions without communication remains challenging. To address this, we propose a novel non-communication MARL framework that realizes the construction of cognition through local observation-based modeling (i.e., "Think"). Our framework enables agents to model teammates' active inference process. At first, the proposed method produces three teammate portraits: perception-belief-action. Specifically, we model the teammate's decision process as follows: 1) Perception: observing environments; 2) Belief: forming beliefs; 3) Action: making decisions. Then, we selectively integrate the belief portrait into the decision process based on the accuracy and relevance of the perception portrait. This enables the selection of cooperative teammates and facilitates effective collaboration. Extensive experiments on the SMAC, SMACv2, MPE, and GRF benchmarks demonstrate the superior performance of our method.

Authors

• Hao Wu Beijing Jiaotong University Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence
• Shoucheng Song Beijing Jiaotong University Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence
• Chang Yao Beijing Jiaotong University Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence
• Sheng Han Beijing Jiaotong University Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence
• Huaiyu Wan School of Computer Science & Technology, Beijing Jiaotong University, Beijing, China Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence, Beijing, China
• Youfang Lin Beijing Jiaotong University Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence
• Kai Lv Beijing Jiaotong University Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence

Keywords

No keywords are indexed for this paper.