Statistical morphological disambiguation for agglutinative languages

Dilek Z. Hakkani-Tür, Kemal Oflazer, Gökhan Tür

Research output: Contribution to journalArticle

51 Citations (Scopus)

Abstract

We present statistical models for morphological disambiguation in agglutinative languages, with a specific application to Turkish. Turkish presents an interesting problem for statistical models as the potential tag set size is very large because of the productive derivational morphology. We propose to handle this by breaking up the morhosyntactic tags into inflectional groups, each of which contains the inflectional features for each (intermediate) derived form. Our statistical models score the probability of each morhosyntactic tag by considering statistics over the individual inflectional groups and surface roots in trigram models. Among the four models that we have developed and tested, the simplest model ignoring the local morphotactics within words performs the best. Our best trigram model performs with 93.95% accuracy on our test data getting all the morhosyntactic and semantic features correct. If we are just interested in syntactically relevant features and ignore a very small set of semantic features, then the accuracy increases to 95.07%.

Original languageEnglish
Pages (from-to)381-410
Number of pages30
JournalComputers and the Humanities
Volume36
Issue number4
DOIs
Publication statusPublished - 2002
Externally publishedYes

    Fingerprint

Keywords

  • Agglutinative languages
  • Morphological disambiguation
  • N-gram language models
  • Statistical natural language processing
  • Turkish

ASJC Scopus subject areas

  • Social Sciences(all)

Cite this