Infinite-horizon proactive dynamic DCOPs

Khoi D. Hoang, Ping Hou, Ferdinando Fioretto, William Yeoh, Roie Zivan, Makoto Yokoo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

The Distributed Constraint Optimization Problem (DCOP) formulation is a powerful tool for modeling multi-Agent coordination problems. Researchers have recently extended this model to Proactive Dynamic DCOPs (PD-DCOPs) to capture the inherent dynamism present in many coordination problems. The PD-DCOP formulation is a finite-horizon model that assumes a finite horizon is known a priori. It ignores changes to the problem after the horizon and is thus not guaranteed to find optimal solutions for infinite-horizon problems, which often occur in the real world. Therefore, we (i) propose the Infinite-Horizon PD-DCOP (IPD- DCOP) model, which extends PD-DCOPs to handle infinite horizons', (ii) exploit the convergence properties of Markov chains to determine the optimal solution to the problem after it has converged; (Hi) propose three distributed greedy algorithms to solve IPD-DCOPs; (iv) provide theoretical quality guarantees on the new model; and (v) empirically evaluate both proactive and reactive algorithms to determine the tradeoffs between the two classes. The final contribution is important as, thus far. researchers have exclusively evaluated the two classes of algorithms in isolation. As a result, it is difficult to identify the characteristics of problems that they excel in. Our results arc the first in this important direction.

Original languageEnglish
Title of host publication16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017
EditorsEdmund Durfee, Sanmay Das, Kate Larson, Michael Winikoff
PublisherInternational Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)
Pages212-220
Number of pages9
Volume1
ISBN (Electronic)9781510855076
Publication statusPublished - Jan 1 2017
Event16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017 - Sao Paulo, Brazil
Duration: May 8 2017May 12 2017

Other

Other16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017
CountryBrazil
CitySao Paulo
Period5/8/175/12/17

Fingerprint

Parallel algorithms
Markov processes
Dynamic models

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Software
  • Control and Systems Engineering

Cite this

Hoang, K. D., Hou, P., Fioretto, F., Yeoh, W., Zivan, R., & Yokoo, M. (2017). Infinite-horizon proactive dynamic DCOPs. In E. Durfee, S. Das, K. Larson, & M. Winikoff (Eds.), 16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017 (Vol. 1, pp. 212-220). International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).

Infinite-horizon proactive dynamic DCOPs. / Hoang, Khoi D.; Hou, Ping; Fioretto, Ferdinando; Yeoh, William; Zivan, Roie; Yokoo, Makoto.

16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017. ed. / Edmund Durfee; Sanmay Das; Kate Larson; Michael Winikoff. Vol. 1 International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS), 2017. p. 212-220.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hoang, KD, Hou, P, Fioretto, F, Yeoh, W, Zivan, R & Yokoo, M 2017, Infinite-horizon proactive dynamic DCOPs. in E Durfee, S Das, K Larson & M Winikoff (eds), 16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017. vol. 1, International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS), pp. 212-220, 16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017, Sao Paulo, Brazil, 5/8/17.
Hoang KD, Hou P, Fioretto F, Yeoh W, Zivan R, Yokoo M. Infinite-horizon proactive dynamic DCOPs. In Durfee E, Das S, Larson K, Winikoff M, editors, 16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017. Vol. 1. International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS). 2017. p. 212-220
Hoang, Khoi D. ; Hou, Ping ; Fioretto, Ferdinando ; Yeoh, William ; Zivan, Roie ; Yokoo, Makoto. / Infinite-horizon proactive dynamic DCOPs. 16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017. editor / Edmund Durfee ; Sanmay Das ; Kate Larson ; Michael Winikoff. Vol. 1 International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS), 2017. pp. 212-220
@inproceedings{6bf6b6a289c94f908e4474e3b9ddfa6c,
title = "Infinite-horizon proactive dynamic DCOPs",
abstract = "The Distributed Constraint Optimization Problem (DCOP) formulation is a powerful tool for modeling multi-Agent coordination problems. Researchers have recently extended this model to Proactive Dynamic DCOPs (PD-DCOPs) to capture the inherent dynamism present in many coordination problems. The PD-DCOP formulation is a finite-horizon model that assumes a finite horizon is known a priori. It ignores changes to the problem after the horizon and is thus not guaranteed to find optimal solutions for infinite-horizon problems, which often occur in the real world. Therefore, we (i) propose the Infinite-Horizon PD-DCOP (IPD- DCOP) model, which extends PD-DCOPs to handle infinite horizons', (ii) exploit the convergence properties of Markov chains to determine the optimal solution to the problem after it has converged; (Hi) propose three distributed greedy algorithms to solve IPD-DCOPs; (iv) provide theoretical quality guarantees on the new model; and (v) empirically evaluate both proactive and reactive algorithms to determine the tradeoffs between the two classes. The final contribution is important as, thus far. researchers have exclusively evaluated the two classes of algorithms in isolation. As a result, it is difficult to identify the characteristics of problems that they excel in. Our results arc the first in this important direction.",
author = "Hoang, {Khoi D.} and Ping Hou and Ferdinando Fioretto and William Yeoh and Roie Zivan and Makoto Yokoo",
year = "2017",
month = "1",
day = "1",
language = "English",
volume = "1",
pages = "212--220",
editor = "Edmund Durfee and Sanmay Das and Kate Larson and Michael Winikoff",
booktitle = "16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017",
publisher = "International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)",

}

TY - GEN

T1 - Infinite-horizon proactive dynamic DCOPs

AU - Hoang, Khoi D.

AU - Hou, Ping

AU - Fioretto, Ferdinando

AU - Yeoh, William

AU - Zivan, Roie

AU - Yokoo, Makoto

PY - 2017/1/1

Y1 - 2017/1/1

N2 - The Distributed Constraint Optimization Problem (DCOP) formulation is a powerful tool for modeling multi-Agent coordination problems. Researchers have recently extended this model to Proactive Dynamic DCOPs (PD-DCOPs) to capture the inherent dynamism present in many coordination problems. The PD-DCOP formulation is a finite-horizon model that assumes a finite horizon is known a priori. It ignores changes to the problem after the horizon and is thus not guaranteed to find optimal solutions for infinite-horizon problems, which often occur in the real world. Therefore, we (i) propose the Infinite-Horizon PD-DCOP (IPD- DCOP) model, which extends PD-DCOPs to handle infinite horizons', (ii) exploit the convergence properties of Markov chains to determine the optimal solution to the problem after it has converged; (Hi) propose three distributed greedy algorithms to solve IPD-DCOPs; (iv) provide theoretical quality guarantees on the new model; and (v) empirically evaluate both proactive and reactive algorithms to determine the tradeoffs between the two classes. The final contribution is important as, thus far. researchers have exclusively evaluated the two classes of algorithms in isolation. As a result, it is difficult to identify the characteristics of problems that they excel in. Our results arc the first in this important direction.

AB - The Distributed Constraint Optimization Problem (DCOP) formulation is a powerful tool for modeling multi-Agent coordination problems. Researchers have recently extended this model to Proactive Dynamic DCOPs (PD-DCOPs) to capture the inherent dynamism present in many coordination problems. The PD-DCOP formulation is a finite-horizon model that assumes a finite horizon is known a priori. It ignores changes to the problem after the horizon and is thus not guaranteed to find optimal solutions for infinite-horizon problems, which often occur in the real world. Therefore, we (i) propose the Infinite-Horizon PD-DCOP (IPD- DCOP) model, which extends PD-DCOPs to handle infinite horizons', (ii) exploit the convergence properties of Markov chains to determine the optimal solution to the problem after it has converged; (Hi) propose three distributed greedy algorithms to solve IPD-DCOPs; (iv) provide theoretical quality guarantees on the new model; and (v) empirically evaluate both proactive and reactive algorithms to determine the tradeoffs between the two classes. The final contribution is important as, thus far. researchers have exclusively evaluated the two classes of algorithms in isolation. As a result, it is difficult to identify the characteristics of problems that they excel in. Our results arc the first in this important direction.

UR - http://www.scopus.com/inward/record.url?scp=85046488134&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85046488134&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85046488134

VL - 1

SP - 212

EP - 220

BT - 16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2017

A2 - Durfee, Edmund

A2 - Das, Sanmay

A2 - Larson, Kate

A2 - Winikoff, Michael

PB - International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)

ER -