Introducing communication in Dis-POMDPs with Finite State Machines

Yuki Iwanari, Makoto Tasaki, Makoto Yokoo, Atsushi Iwasaki, Yuko Sakurai

研究成果: Chapter in Book/Report/Conference proceedingConference contribution

1 被引用数 (Scopus)

抄録

Distributed Partially Observable Markov Decision Problems (Dis-POMDPs) are emerging as a popular approach for modeling sequential decision making in teams operating under uncertainty. To achieve coherent behaviors of agents, it is essential to perform appropriate run-time communication. Thus, there have been many works on the run-time communication schemes in Dis-POMDPs. Also, a Finite State Machine (FSM) is a popular representation for describing a local policy that works in a very long or infinite time horizon. In this paper, we examine a run-time communication scheme when the local policy of each agent is represented as an FSM. In this scheme, the meaning of each message is not predefined; it is given implicitly by the interaction between local policies. We propose an iterative-improvement type algorithm that searches for a joint policy where run-time communication incurs some cost. Thus, agents use run-time communication only when doing so is cost-effective. Interestingly, our algorithm can find a joint policy that obtains a better expected reward than a hand-crafted joint policy, and it requires fewer nodes in the local FSM and fewer message types. Furthermore, we experimentally show that our algorithm can obtain a joint policy that consists of sufficiently complex local FSMs within a reasonable amount of time.

本文言語英語
ホスト出版物のタイトルProceedings - 2009 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT 2009
ページ267-270
ページ数4
DOI
出版ステータス出版済み - 12 1 2009
イベント2009 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2009 - Milano, イタリア
継続期間: 9 15 20099 18 2009

出版物シリーズ

名前Proceedings - 2009 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT 2009
2

その他

その他2009 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2009
国/地域イタリア
CityMilano
Period9/15/099/18/09

All Science Journal Classification (ASJC) codes

  • コンピュータ ネットワークおよび通信
  • ソフトウェア

フィンガープリント

「Introducing communication in Dis-POMDPs with Finite State Machines」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル