Introducing communication in Dis-POMDPs with locality of interaction

Makoto Tasaki, Yuichi Yabu, Yuki Iwanari, Makoto Yokoo, Milind Tambe, Janusz Marecki, Pradeep Varakantham

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

The Networked Distributed POMDPs (ND-POMDPs) can model multiagent systems in uncertain domains and has begun to scale-up the number of agents. However, prior work in ND-POMDPs has failed to address communication. Without communication, the size of a local policy at each agent within the ND-POMDPs grows exponentially in the time horizon. To overcome this problem, we extend existing algorithms so that agents periodically communicate their observation and action histories with each other. After communication, agents can start from new synchronized belief state. Thus, we can avoid the exponential growth in the size of local policies at agents. Furthermore, we introduce an idea that is similar the Point-based Value Iteration algorithm to approximate the value function with a fixed number of representative points. Our experimental results show that we can obtain much longer policies than existing algorithms as long as the interval between communications is small.

Original languageEnglish
Title of host publicationProceedings - 2008 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT 2008
Pages169-175
Number of pages7
DOIs
Publication statusPublished - 2008
Event2008 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT 2008 - Sydney, NSW, Australia
Duration: Dec 9 2008Dec 12 2008

Publication series

NameProceedings - 2008 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT 2008

Other

Other2008 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT 2008
CountryAustralia
CitySydney, NSW
Period12/9/0812/12/08

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Software

Fingerprint Dive into the research topics of 'Introducing communication in Dis-POMDPs with locality of interaction'. Together they form a unique fingerprint.

Cite this