Publication - Multiagent Meta-level Control for Radar Coordination

Authors: Cheng, Shanjun; Raja, Anita; and Lesser Victor
Title: Multiagent Meta-level Control for Radar Coordination
Abstract: It is crucial for embedded systems to adapt to the dynamics of open environments. This adaptation process becomes especially challenging in the context of multiagent systems. In this paper, we argue that multiagent meta-level control is an effective way to determine when this adaptation process should be done and how much effort should be invested in adaptation as opposed to continuing with the current action plan. We use a reinforcement learning based local optimization algorithm within each agent to learn multiagent meta-level control agent policies in a decentralized fashion. These policies will allow each agent to adapt to changes in environmental conditions while reorganizing the underlying multiagent network when needed. We then augment the agent with a heuristic rule-based algorithm that uses information provided by the reinforcement learning algorithm in order to resolve conflicts among agent policies from a local perspective at both learning and execution stages. We evaluate this mechanism in the context of a multiagent tornado tracking application called NetRads. Empirical results show that adaptive multiagent meta-level control significantly improves the performance of the tornado tracking network for a variety of weather scenarios.
Keywords: Conflict Resolution, Control, MDP, Multi-Agent Systems
Publication: Web Intelligence and Agent Systems: An International Journal, Vol: 11, Num: 2, pp. 81 - 105
Publisher: IOS Press
Date: 2013
Sources: PDF: /Documents/WIAS_NetRads_Cheng.pdf
Reference: Cheng, Shanjun; Raja, Anita; and Lesser Victor. Multiagent Meta-level Control for Radar Coordination. Web Intelligence and Agent Systems: An International Journal, Volume 11, Number 2, IOS Press, pp. 81-105. 2013.
bibtex: 
@article{Cheng-512,
  author    = "Shanjun Cheng and Anita Raja and Lesser Victor",
  title     = "{Multiagent Meta-level Control for Radar
               Coordination}",
  journal   = "Web Intelligence and Agent Systems: An
               International Journal",
  volume    = "11",
  number    = "2",
  publisher = "IOS Press",
  pages     = "81-105",
  year      = "2013",
  url       = "http://mas.cs.umass.edu/paper/512",
}