Language model adaptation for statistical machine translation based on information retrieval

Matthias Eck, Stephan Vogel, Alex Waibel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

41 Citations (Scopus)

Abstract

Language modeling is an important part for both speech recognition and machine translation systems. Adaptation has been successfully applied to language models for speech recognition. In this paper we present experiments concerning language model adaptation for statistical machine translation. We develop a method to adapt language models using information retrieval methods. The adapted language models drastically reduce perplexity over a general language model and we can show that it is possible to improve the translation quality of a statistical machine translation using those adapted language models instead of a general language model.

Original languageEnglish
Title of host publicationProceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004
PublisherEuropean Language Resources Association (ELRA)
Pages327-330
Number of pages4
ISBN (Electronic)2951740816, 9782951740815
Publication statusPublished - 1 Jan 2004
Externally publishedYes
Event4th International Conference on Language Resources and Evaluation, LREC 2004 - Lisbon, Portugal
Duration: 26 May 200428 May 2004

Other

Other4th International Conference on Language Resources and Evaluation, LREC 2004
CountryPortugal
CityLisbon
Period26/5/0428/5/04

Fingerprint

information retrieval
language
Language Model
Statistical Machine Translation
Information Retrieval
experiment

ASJC Scopus subject areas

  • Library and Information Sciences
  • Education
  • Language and Linguistics
  • Linguistics and Language

Cite this

Eck, M., Vogel, S., & Waibel, A. (2004). Language model adaptation for statistical machine translation based on information retrieval. In Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004 (pp. 327-330). European Language Resources Association (ELRA).

Language model adaptation for statistical machine translation based on information retrieval. / Eck, Matthias; Vogel, Stephan; Waibel, Alex.

Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004. European Language Resources Association (ELRA), 2004. p. 327-330.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Eck, M, Vogel, S & Waibel, A 2004, Language model adaptation for statistical machine translation based on information retrieval. in Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004. European Language Resources Association (ELRA), pp. 327-330, 4th International Conference on Language Resources and Evaluation, LREC 2004, Lisbon, Portugal, 26/5/04.
Eck M, Vogel S, Waibel A. Language model adaptation for statistical machine translation based on information retrieval. In Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004. European Language Resources Association (ELRA). 2004. p. 327-330
Eck, Matthias ; Vogel, Stephan ; Waibel, Alex. / Language model adaptation for statistical machine translation based on information retrieval. Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004. European Language Resources Association (ELRA), 2004. pp. 327-330
@inproceedings{bcee3b9c08194508bd693eefd3b5a035,
title = "Language model adaptation for statistical machine translation based on information retrieval",
abstract = "Language modeling is an important part for both speech recognition and machine translation systems. Adaptation has been successfully applied to language models for speech recognition. In this paper we present experiments concerning language model adaptation for statistical machine translation. We develop a method to adapt language models using information retrieval methods. The adapted language models drastically reduce perplexity over a general language model and we can show that it is possible to improve the translation quality of a statistical machine translation using those adapted language models instead of a general language model.",
author = "Matthias Eck and Stephan Vogel and Alex Waibel",
year = "2004",
month = "1",
day = "1",
language = "English",
pages = "327--330",
booktitle = "Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004",
publisher = "European Language Resources Association (ELRA)",

}

TY - GEN

T1 - Language model adaptation for statistical machine translation based on information retrieval

AU - Eck, Matthias

AU - Vogel, Stephan

AU - Waibel, Alex

PY - 2004/1/1

Y1 - 2004/1/1

N2 - Language modeling is an important part for both speech recognition and machine translation systems. Adaptation has been successfully applied to language models for speech recognition. In this paper we present experiments concerning language model adaptation for statistical machine translation. We develop a method to adapt language models using information retrieval methods. The adapted language models drastically reduce perplexity over a general language model and we can show that it is possible to improve the translation quality of a statistical machine translation using those adapted language models instead of a general language model.

AB - Language modeling is an important part for both speech recognition and machine translation systems. Adaptation has been successfully applied to language models for speech recognition. In this paper we present experiments concerning language model adaptation for statistical machine translation. We develop a method to adapt language models using information retrieval methods. The adapted language models drastically reduce perplexity over a general language model and we can show that it is possible to improve the translation quality of a statistical machine translation using those adapted language models instead of a general language model.

UR - http://www.scopus.com/inward/record.url?scp=85031046566&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85031046566&partnerID=8YFLogxK

M3 - Conference contribution

SP - 327

EP - 330

BT - Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004

PB - European Language Resources Association (ELRA)

ER -