Recent scaling up of POMDP solvers towards realistic applications is largely due to point-based methods which quickly converge to an approximate solution for medium-sized problems. Of this family HSVI, which uses trial-based asynchronous value iteration, can handle the largest domains. In this paper we suggest a new algorithm, FSVI, that uses the underlying MDP to traverse the belief space towards rewards, finding sequences of useful backups, and show how it scales up better than HSVI on larger benchmarks.

Authors

• Guy Shani MSAI, Microsoft & Ben Gurion University of the Negev
• Ronen I. Brafman Ben-Gurion University
• Solomon E. Shimony

Keywords

No keywords are indexed for this paper.