Towards heterogeneous automatic MT error analysis

Jesús Giménez, Lluis Marques

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

This work studies the viability of performing heterogeneous automatic MT error analyses. Error analysis is, undoubtly, one of the most crucial stages in the development cycle of an MT system. However, often not enough attention is paid to this process. The reason is that performing an accurate error analysis requires intensive human labor. In order to speed up the error analysis process, we suggest partially automatizing it by having automatic evaluation metrics play a more active role. For that purpose, we have compiled a large and heterogeneous set of features at different linguistic levels and at different levels of granularity. Through a practical case study, we show how these features provide an effective means of ellaborating interpretable and detailed automatic reports of translation quality.

Original languageEnglish
Title of host publicationProceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008
PublisherEuropean Language Resources Association (ELRA)
Pages1894-1901
Number of pages8
ISBN (Electronic)2951740840, 9782951740846
Publication statusPublished - 1 Jan 2008
Event6th International Conference on Language Resources and Evaluation, LREC 2008 - Marrakech, Morocco
Duration: 28 May 200830 May 2008

Other

Other6th International Conference on Language Resources and Evaluation, LREC 2008
CountryMorocco
CityMarrakech
Period28/5/0830/5/08

Fingerprint

process analysis
labor
linguistics
Error Analysis
evaluation
Labor
Evaluation
Granularity

ASJC Scopus subject areas

  • Library and Information Sciences
  • Linguistics and Language
  • Language and Linguistics
  • Education

Cite this

Giménez, J., & Marques, L. (2008). Towards heterogeneous automatic MT error analysis. In Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008 (pp. 1894-1901). European Language Resources Association (ELRA).

Towards heterogeneous automatic MT error analysis. / Giménez, Jesús; Marques, Lluis.

Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008. European Language Resources Association (ELRA), 2008. p. 1894-1901.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Giménez, J & Marques, L 2008, Towards heterogeneous automatic MT error analysis. in Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008. European Language Resources Association (ELRA), pp. 1894-1901, 6th International Conference on Language Resources and Evaluation, LREC 2008, Marrakech, Morocco, 28/5/08.
Giménez J, Marques L. Towards heterogeneous automatic MT error analysis. In Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008. European Language Resources Association (ELRA). 2008. p. 1894-1901
Giménez, Jesús ; Marques, Lluis. / Towards heterogeneous automatic MT error analysis. Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008. European Language Resources Association (ELRA), 2008. pp. 1894-1901
@inproceedings{aa9e1b59771240e39fa15f547b86bbac,
title = "Towards heterogeneous automatic MT error analysis",
abstract = "This work studies the viability of performing heterogeneous automatic MT error analyses. Error analysis is, undoubtly, one of the most crucial stages in the development cycle of an MT system. However, often not enough attention is paid to this process. The reason is that performing an accurate error analysis requires intensive human labor. In order to speed up the error analysis process, we suggest partially automatizing it by having automatic evaluation metrics play a more active role. For that purpose, we have compiled a large and heterogeneous set of features at different linguistic levels and at different levels of granularity. Through a practical case study, we show how these features provide an effective means of ellaborating interpretable and detailed automatic reports of translation quality.",
author = "Jes{\'u}s Gim{\'e}nez and Lluis Marques",
year = "2008",
month = "1",
day = "1",
language = "English",
pages = "1894--1901",
booktitle = "Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008",
publisher = "European Language Resources Association (ELRA)",

}

TY - GEN

T1 - Towards heterogeneous automatic MT error analysis

AU - Giménez, Jesús

AU - Marques, Lluis

PY - 2008/1/1

Y1 - 2008/1/1

N2 - This work studies the viability of performing heterogeneous automatic MT error analyses. Error analysis is, undoubtly, one of the most crucial stages in the development cycle of an MT system. However, often not enough attention is paid to this process. The reason is that performing an accurate error analysis requires intensive human labor. In order to speed up the error analysis process, we suggest partially automatizing it by having automatic evaluation metrics play a more active role. For that purpose, we have compiled a large and heterogeneous set of features at different linguistic levels and at different levels of granularity. Through a practical case study, we show how these features provide an effective means of ellaborating interpretable and detailed automatic reports of translation quality.

AB - This work studies the viability of performing heterogeneous automatic MT error analyses. Error analysis is, undoubtly, one of the most crucial stages in the development cycle of an MT system. However, often not enough attention is paid to this process. The reason is that performing an accurate error analysis requires intensive human labor. In order to speed up the error analysis process, we suggest partially automatizing it by having automatic evaluation metrics play a more active role. For that purpose, we have compiled a large and heterogeneous set of features at different linguistic levels and at different levels of granularity. Through a practical case study, we show how these features provide an effective means of ellaborating interpretable and detailed automatic reports of translation quality.

UR - http://www.scopus.com/inward/record.url?scp=80052759026&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052759026&partnerID=8YFLogxK

M3 - Conference contribution

SP - 1894

EP - 1901

BT - Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

PB - European Language Resources Association (ELRA)

ER -