A graph-based strategy to streamline translation quality assessments

Daniele Pighin, Lluís Formiga, Lluis Marques

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We present a detailed analysis of a graphbased annotation strategy that we employed to annotate a corpus of 11,292 real-world English to Spanish automatic translations with relative (ranking) and absolute (adequate/nonadequate) quality assessments. The proposed approach, inspired by previous work in Interactive Evolutionary Computation and Interactive Genetic Algorithms, results in a simpler and faster annotation process. We empirically compare the method against a traditional, explicit ranking approach, and show that the graph-based strategy: 1) is considerably faster, and 2) produces consistently more reliable annotations.

Original languageEnglish
Title of host publicationAMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas
PublisherAssociation for Machine Translation in the Americas
Publication statusPublished - 2012
Externally publishedYes
Event10th Conference of the Association for Machine Translation in the Americas, AMTA 2012 - San Diego, United States
Duration: 28 Oct 20121 Nov 2012

Other

Other10th Conference of the Association for Machine Translation in the Americas, AMTA 2012
CountryUnited States
CitySan Diego
Period28/10/121/11/12

    Fingerprint

ASJC Scopus subject areas

  • Language and Linguistics
  • Software
  • Human-Computer Interaction

Cite this

Pighin, D., Formiga, L., & Marques, L. (2012). A graph-based strategy to streamline translation quality assessments. In AMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas Association for Machine Translation in the Americas.