Evaluating a dialog language generation system: Comparing the MOUNTAIN system to other NLG approaches

Brian Langner, Stephan Vogel, Alan W. Black

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This paper describes the MOUNTAIN language generation system, a fully-automatic, data-driven approach to natural language generation aimed at spoken dialog applications. MOUNTAIN uses statistical machine translation techniques and natural corpora to generate human-like language from a structured internal language, such as a representation of the dialog state. We briefly describe the training process for the MOUNTAIN approach, and show results of automatic evaluation in a standard language generation domain: the METEO weather forecasting corpus. Further, we compare output from the MOUNTAIN system to several other NLG systems in the same domain, using both automatic and human-based evaluation metrics; our results show our approach is comparable in quality to other advanced approaches. Finally, we discuss potential extensions, improvements, and other planned tests.

Original languageEnglish
Title of host publicationProceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010
Pages1109-1112
Number of pages4
Publication statusPublished - 1 Dec 2010
Externally publishedYes
Event11th Annual Conference of the International Speech Communication Association: Spoken Language Processing for All, INTERSPEECH 2010 - Makuhari, Chiba, Japan
Duration: 26 Sep 201030 Sep 2010

Other

Other11th Annual Conference of the International Speech Communication Association: Spoken Language Processing for All, INTERSPEECH 2010
CountryJapan
CityMakuhari, Chiba
Period26/9/1030/9/10

    Fingerprint

Keywords

  • Evaluation
  • Natural language generation
  • Spoken dialog
  • Translation-based generation
  • Weather forecasts

ASJC Scopus subject areas

  • Language and Linguistics
  • Speech and Hearing

Cite this

Langner, B., Vogel, S., & Black, A. W. (2010). Evaluating a dialog language generation system: Comparing the MOUNTAIN system to other NLG approaches. In Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010 (pp. 1109-1112)