Towards a Unifying Characterization for Quantifying Weak Coupling in Dec-POMDPs

Researchers in the field of multiagent sequential decision making have commonly used the terms "weakly-coupled" and "loosely-coupled" to qualitatively classify problems involving agents whose interactions are limited, and to identify various structural restrictions that yield computational advantages to decomposing agents' centralized planning and reasoning into largely-decentralized planning and reasoning. Together, these restrictions make up a heterogeneous collection of facets of "weakly-coupled" structure that are conceptually related, but whose purported computational benefits are hard to compare evenhandedly. The contribution of this paper is a unified characterization of weak coupling that brings together three complementary aspects of agent interaction structure. By considering these aspects in combination, we derive new bounds on the computational complexity of optimal DecPOMDP planning, that together quantify the relative benefits of exploiting different forms of interaction structure. Further, we demonstrate how our characterizations can be used to explain why existing classes of decoupled solution algorithms perform well on some problems but poorly on others, as well as to predict the performance of a particular algorithm from identifiable problem attributes.

Authors

• Stefan J. Witwicki
• Edmund H. Durfee

Keywords

• Multiagent Planning
• Coordination
• Weak Coupling
• Loose Coupling
• Locality of Interaction
• Policy Abstraction
• Influence
• Decentralized Markov Decision Processes
• POMDPs