Filtering-ranking perceptron learning for partial parsing

Xavier Carreras, Lluís Màrquez, Jorge Castro

Research output: Contribution to journalArticle

17 Citations (Scopus)

Abstract

This work introduces a general phrase recognition system based on perceptrons, and a global online learning algorithm to train them together. The method applies to complex domains in which some structure has to be recognized. This global problem is broken down into two layers of local subproblems: a filtering layer, which reduces the search space by identifying plausible phrase candidates; and a ranking layer, which builds the optimal phrase structure by discriminating among competing phrases. A recognition-based feedback rule is presented which reflects to each local function its committed errors from a global point of view, and allows to train them together online as perceptrons. As a result, the learned functions automatically behave as filters and rankers, rather than binary classifiers, which we argue to be better for this type of problems. Extensive experimentation on partial parsing tasks gives state-of-the-art results and evinces the advantages of the global training method over optimizing each function locally and independently.

Original languageEnglish
Pages (from-to)41-71
Number of pages31
JournalMachine Learning
Volume60
Issue number1-3
DOIs
Publication statusPublished - 1 Sep 2005

    Fingerprint

Keywords

  • Natural language processing
  • Online learning
  • Partial parsing
  • Perceptron
  • Sequential data
  • Structure recognition

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this