Publication - Leveraging Failures to Enhance Hierarchical Concept Learning when Training and Testing are Limited

Authors: Zafar, Huzaifa; Corkill, Daniel
Title: Leveraging Failures to Enhance Hierarchical Concept Learning when Training and Testing are Limited
Abstract: Hierarchical concept learning constructs higher-level concepts using previously learned prerequisite concepts. We are working in an especially challenging context where only a small number of training instances for each concept are provided to the learning system. This limited instruction forces even the most skillful learner to make assumptions about the concept being taught---assumptions that can be incorrect. Given this uncertainty, multiple candidates may be proposed for the concept, each stemming from different assumptions that are consistent with the training.

We present a control strategy for managing the use of hypothesized concept candidates in higher-level learning. The strategy is based on three key ideas: 1) limiting prerequisite-candidate combinatorics by operating with a single selected candidate for each concept at any time, 2) using learning failure to select a different candidate for a direct or indirect prerequisite concept, and 3) using differences observed as candidates are used to guide candidate selection. We implemented and evaluated this novel Concept Candidate Management (CCM) strategy in MABLE, an electronic student that performs bootstrapped concept learning. Using the CCM strategy, MABLE learned concepts that were not successfully learned otherwise---without any additional training or testing and without any changes to learning algorithms.
Keywords: Blackboard, Control, Search
Publication: University of Massachusetts Amherst Computer Science Technical Report #2011-026
Date: July 2011
Sources: PDF: https://www.cs.umass.edu/publication/docs/2011/UM-CS-2011-026.pdf
Reference: Zafar, Huzaifa; Corkill, Daniel. Leveraging Failures to Enhance Hierarchical Concept Learning when Training and Testing are Limited. University of Massachusetts Amherst Computer Science Technical Report #2011-026. July 2011.
bibtex:
@techreport{Zafar-509,
  author    = "Huzaifa Zafar and Daniel Corkill",
  title     = "{Leveraging Failures to Enhance Hierarchical
               Concept Learning when Training and Testing are
               Limited}",
  month     = "July",
  year      = "2011",
  url       = "http://mas.cs.umass.edu/paper/509",
}