Publication - Automated Meta-Level Control Reasoning in Complex Agents

Authors: Raja, Anita; Lesser, Victor
Title: Automated Meta-Level Control Reasoning in Complex Agents
Abstract: Complex agents operating in open environments must make real-time control decisions on scheduling and planning of domain actions. These decisions are made in the context of limited resources and uncertainty about outcomes of actions. The question of how to sequence domain and control actions without consuming too many resources in the process is the meta-level control problem for a resource-bounded rational agent. Our approach is to design and build a meta-level control agent architecture with bounded computational overhead. It supports decisions on when to accept, delay or reject a new task, how much effort to put into scheduling when reasoning about a new task and whether to reschedule when actual execution performance deviates from expected performance. We show that efficient meta-level control leads to significant improvement in performance and provide empirical results based on hand-generated heuristics and reinforcement learning to support our claim.
Keywords: Agent Control, Learning, MDP, Resource Bounded, Scheduling, Uncertainty
Publication: Proceedings of workshop on Agents and Automated Reasoning in the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI 2003)
Date: August 2003
Sources: PS: /Documents/araja/IJCAI03WS.ps
PDF: /Documents/IJCAI03WS.pdf
Reference: Raja, Anita; Lesser, Victor. Automated Meta-Level Control Reasoning in Complex Agents. Proceedings of workshop on Agents and Automated Reasoning in the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI 2003). August 2003.
bibtex:
@article{Raja-252,
  author    = "Anita Raja and Victor Lesser",
  title     = "{Automated Meta-Level Control Reasoning in Complex
               Agents}",
  journal   = "Proceedings of  workshop on Agents and Automated
               Reasoning in the Eighteenth International Joint
               Conference on Artificial Intelligence (IJCAI 2003)",
  month     = "August",
  year      = "2003",
  url       = "http://mas.cs.umass.edu/paper/252",
}