Winning back the CUP for distributed POMDPs: Planning over continuous belief spaces

Pradeep Varakantham, Ranjit Nair, Milind Tambe, Makoto Yokoo

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

4 被引用数 (Scopus)

抄録

Distributed Partially Observable Markov Decision Problems (Distributed POMDPs) are evolving as a popular approach for modeling multiagent systems, and many different algorithms have been proposed to obtain locally or globally optimal policies. Unfortunately, most of these algorithms have either been explicitly designed or experimentally evaluated assuming knowledge of a starting belief point, an assumption that often does not hold in complex, uncertain domains. Instead, in such domains, it is important for agents to explicitly plan over continuous belief spaces. This paper provides a novel algorithm to explicitly compute finite horizon policies over continuous belief spaces, without restricting the space of policies. By marrying an efficient single-agent POMDP solver with a heuristic distributed POMDP policy-generation algorithm, locally optimal joint policies are obtained, each of which dominates within a different part of the belief region. We provide heuristics that significantly improve the efficiency of the resulting algorithm and provide detailed experimental results. To the best of our knowledge, these are the first run-time results for analytically generating policies over continuous belief spaces in distributed POMDPs.

本文言語英語
ホスト出版物のタイトルProceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems
ページ289-296
ページ数8
DOI
出版ステータス出版済み - 2006
イベントFifth International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS - Hakodate, 日本
継続期間: 5 8 20065 12 2006

出版物シリーズ

名前Proceedings of the International Conference on Autonomous Agents
2006

その他

その他Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS
国/地域日本
CityHakodate
Period5/8/065/12/06

All Science Journal Classification (ASJC) codes

  • 工学(全般)

フィンガープリント

「Winning back the CUP for distributed POMDPs: Planning over continuous belief spaces」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル