Scalable Solution Methods for Dec-POMDPs with Deterministic Dynamics

Many high-level multi-agent planning problems, such as multi-robot navigation and path planning, can be modeled with deterministic actions and observations. In this work, we focus on such domains and introduce the class of Deterministic Decentralized POMDPs (Det-Dec-POMDPs)—a subclass of Dec-POMDPs with deterministic transitions and observations given the state and joint actions. We then propose a practical solver, Iterative Deterministic POMDP Planning (IDPP), based on the classic Joint Equilibrium Search for Policies framework, specifically optimized to handle large-scale Det-Dec-POMDPs that existing Dec-POMDP solvers cannot handle efficiently.

Authors

• Yang You Shanghai Jiao Tong University
• Alex Schutz University of Oxford
• Zhikun Li University of Oxford
• Bruno Lacerda Oxford Robotics Institute, University of Oxford
• Robert Skilton UK Atomic Energy Authority
• Nick Hawes Oxford Robotics Institute, University of Oxford

Keywords

No keywords are indexed for this paper.