Publication - Communication Decisions in Multi-agent Cooperation: Model and Experiments

Authors: Xuan, P.; Lesser, V.; Zilberstein, S.
Title: Communication Decisions in Multi-agent Cooperation: Model and Experiments
Abstract: In multi-agent cooperation, agents share a common goal, which is evaluated through a global utility function. However, an agent typically cannot observe the global state of an uncertain environment, and therefore they must communicate with each other in order to share the information needed for deciding which action to take. We argue that, when communication incurs a cost ( due to resource consumption, for example), whether to communicate or not also becomes a decision to make. Hence, communication decision becomes part of the overall agent decision problem. In order to explicitly address this problem, we present a multi-agent extension to Markov decision processes in which communication can be modeled as an explicit action that incurs a cost. This framework provides a foundation for a quantified study of agent coordination policies and provides both motivation and insight to the design of heuristic approaches. An example problem is studied under this framework. From this example we can see the impact communication policies have on the overall agent policies, and what implication we can find toward the design of agent coordination policies.
Keywords: Coordination, Distributed MDP, Multi-Agent Systems
Publication: Proceedings of the Fifth International Conference on Autonomous Agents, pp. 616 - 623
Location: Montreal
Publisher: ACM Press
Date: January 2001
Sources: PS: http://mas.cs.umass.edu/~pxuan/publication/AGENTS-01/mamdp.ps
PDF: /Documents/mamdp.pdf
Reference: Xuan, P.; Lesser, V.; Zilberstein, S.. Communication Decisions in Multi-agent Cooperation: Model and Experiments. Proceedings of the Fifth International Conference on Autonomous Agents, ACM Press, pp. 616-623. January 2001.
bibtex:
@article{Xuan-201,
  author    = "P. Xuan and V. Lesser and S. Zilberstein",
  title     = "{Communication Decisions in Multi-agent
               Cooperation: Model and Experiments}",
  journal   = "Proceedings of the Fifth International Conference
               on Autonomous Agents",
  publisher = "ACM Press",
  pages     = "616-623",
  month     = "January",
  year      = "2001",
  address   = "Montreal",
  url       = "http://mas.cs.umass.edu/paper/201",
}