DCOPs meet the realworld: Exploring unknown reward matrices with applications to mobile sensor networks

Manish Jain, Matthew Taylor, Milind Tambe, Makoto Yokoo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

35 Citations (Scopus)

Abstract

Buoyed by recent successes in the area of distributed constraint optimization problems (DCOPs), this paper addresses challenges faced when applying DCOPs to real-world domains. Three fundamental challenges must be addressed for a class of real-world domains, requiring novel DCOP algorithms. First, agents may not know the payoff matrix and must explore the environment to determine rewards associated with variable settings. Second, agents may need to maximize total accumulated reward rather than instantaneous final reward. Third, limited time horizons disallow exhaustive exploration of the environment. We propose and implement a set of novel algorithms that combine decision-theoretic exploration approaches with DCOP-mandated coordination. In addition to simulation results, we implement these algorithms on robots, deploying DCOPs on a distributed mobile sensor network.

Original languageEnglish
Title of host publicationIJCAI-09 - Proceedings of the 21st International Joint Conference on Artificial Intelligence
PublisherInternational Joint Conferences on Artificial Intelligence
Pages181-186
Number of pages6
ISBN (Print)9781577354260
Publication statusPublished - Jan 1 2009
Event21st International Joint Conference on Artificial Intelligence, IJCAI 2009 - Pasadena, United States
Duration: Jul 11 2009Jul 16 2009

Publication series

NameIJCAI International Joint Conference on Artificial Intelligence
ISSN (Print)1045-0823

Conference

Conference21st International Joint Conference on Artificial Intelligence, IJCAI 2009
CountryUnited States
CityPasadena
Period7/11/097/16/09

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

Fingerprint Dive into the research topics of 'DCOPs meet the realworld: Exploring unknown reward matrices with applications to mobile sensor networks'. Together they form a unique fingerprint.

  • Cite this

    Jain, M., Taylor, M., Tambe, M., & Yokoo, M. (2009). DCOPs meet the realworld: Exploring unknown reward matrices with applications to mobile sensor networks. In IJCAI-09 - Proceedings of the 21st International Joint Conference on Artificial Intelligence (pp. 181-186). (IJCAI International Joint Conference on Artificial Intelligence). International Joint Conferences on Artificial Intelligence.