Statistical morphological disambiguation for agglutinative languages

Dilek Z. Hakkani-Tür, Kemal Oflazer, Gökhan Tur

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

We present statistical models for morphological disambiguation in agglutinative languages, with a specific application to Turkish. Turkish presents an interesting problem for statistical models as the potential tag set size is very large because of the productive derivational morphology. We propose to handle this by breaking up the morhosyntactic tags into inflectional groups, each of which contains the inflectional features for each (intermediate) derived form. Our statistical models score the probability of each morhosyntactic tag by considering statistics over the individual inflectional groups and surface roots in trigram models. Among the four models that we have developed and tested, the simplest model ignoring the local morphotactics within words performs the best. Our best trigram model performs with 93.95% accuracy on our test data getting all the morhosyntactic and semantic features correct. If we are just interested in syntactically relevant features and ignore a very small set of semantic features, then the accuracy increases to 95.07%.

Original languageEnglish
Pages (from-to)381-410
Number of pages30
JournalLanguage Resources and Evaluation
Volume36
Issue number4
Publication statusPublished - 1 Dec 2002

    Fingerprint

Keywords

  • Agglutinative languages
  • Morphological disambiguation
  • N-gram language models
  • Statistical natural language processing
  • Turkish

ASJC Scopus subject areas

  • Language and Linguistics
  • Education
  • Linguistics and Language
  • Library and Information Sciences

Cite this

Hakkani-Tür, D. Z., Oflazer, K., & Tur, G. (2002). Statistical morphological disambiguation for agglutinative languages. Language Resources and Evaluation, 36(4), 381-410.