Letting loose a SPIDER on a network of POMDPs: Generating quality guaranteed policies

Pradeep Varakantham, Janusz Marecki, Yuichi Yabu, Milind Tambe, Makoto Yokoo

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

19 被引用数 (Scopus)

抄録

Distributed Partially Observable Markov Decision Problems (Distributed POMDPs) are a popular approach for modeling multi-agent systems acting in uncertain domains. Given the significant complexity of solving distributed POMDPs, particularly as we scale up the numbers of agents, one popular approach has focused on approximate solutions. Though this approach is efficient, the algorithms within this approach do not provide any guarantees on solution quality. A second less popular approach focuses on global optimality, but typical results are available only for two agents, and also at considerable computational cost. This paper overcomes the limitations of both these approaches by providing SPIDER, a novel combination of three key features for policy generation in distributed POMDPs: (i) it exploits agent interaction structure given a network of agents (i.e. allowing easier scale-up to larger number of agents); (ii) it uses a combination of heuristics to speedup policy search; and (iii) it allows quality guaranteed approximations, allowing a systematic tradeoff of solution quality for time. Experimental results show orders of magnitude improvement in performance when compared with previous global optimal algorithms.

本文言語英語
ホスト出版物のタイトルAAMAS'07 - Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems
ページ822-829
ページ数8
DOI
出版ステータス出版済み - 12 1 2007
イベント6th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS'07 - Honolulu, HI, 米国
継続期間: 5 14 20085 18 2008

出版物シリーズ

名前Proceedings of the International Conference on Autonomous Agents

その他

その他6th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS'07
Country米国
CityHonolulu, HI
Period5/14/085/18/08

All Science Journal Classification (ASJC) codes

  • Software
  • Artificial Intelligence
  • Computer Networks and Communications
  • Theoretical Computer Science

フィンガープリント 「Letting loose a SPIDER on a network of POMDPs: Generating quality guaranteed policies」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル