A graph-based strategy to streamline translation quality assessments

Daniele Pighin, Lluís Formiga, Lluis Marques

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We present a detailed analysis of a graphbased annotation strategy that we employed to annotate a corpus of 11,292 real-world English to Spanish automatic translations with relative (ranking) and absolute (adequate/nonadequate) quality assessments. The proposed approach, inspired by previous work in Interactive Evolutionary Computation and Interactive Genetic Algorithms, results in a simpler and faster annotation process. We empirically compare the method against a traditional, explicit ranking approach, and show that the graph-based strategy: 1) is considerably faster, and 2) produces consistently more reliable annotations.

Original languageEnglish
Title of host publicationAMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas
PublisherAssociation for Machine Translation in the Americas
Publication statusPublished - 2012
Externally publishedYes
Event10th Conference of the Association for Machine Translation in the Americas, AMTA 2012 - San Diego, United States
Duration: 28 Oct 20121 Nov 2012

Other

Other10th Conference of the Association for Machine Translation in the Americas, AMTA 2012
CountryUnited States
CitySan Diego
Period28/10/121/11/12

Fingerprint

Evolutionary algorithms
Genetic algorithms
Quality Assessment
Graph
Annotation
Ranking
Genetic Algorithm
Automatic Translation
Evolutionary
World Englishes

ASJC Scopus subject areas

  • Language and Linguistics
  • Software
  • Human-Computer Interaction

Cite this

Pighin, D., Formiga, L., & Marques, L. (2012). A graph-based strategy to streamline translation quality assessments. In AMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas Association for Machine Translation in the Americas.

A graph-based strategy to streamline translation quality assessments. / Pighin, Daniele; Formiga, Lluís; Marques, Lluis.

AMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas. Association for Machine Translation in the Americas, 2012.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Pighin, D, Formiga, L & Marques, L 2012, A graph-based strategy to streamline translation quality assessments. in AMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas. Association for Machine Translation in the Americas, 10th Conference of the Association for Machine Translation in the Americas, AMTA 2012, San Diego, United States, 28/10/12.
Pighin D, Formiga L, Marques L. A graph-based strategy to streamline translation quality assessments. In AMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas. Association for Machine Translation in the Americas. 2012
Pighin, Daniele ; Formiga, Lluís ; Marques, Lluis. / A graph-based strategy to streamline translation quality assessments. AMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas. Association for Machine Translation in the Americas, 2012.
@inproceedings{7f9b6122249645a6be674f01bc46d0a5,
title = "A graph-based strategy to streamline translation quality assessments",
abstract = "We present a detailed analysis of a graphbased annotation strategy that we employed to annotate a corpus of 11,292 real-world English to Spanish automatic translations with relative (ranking) and absolute (adequate/nonadequate) quality assessments. The proposed approach, inspired by previous work in Interactive Evolutionary Computation and Interactive Genetic Algorithms, results in a simpler and faster annotation process. We empirically compare the method against a traditional, explicit ranking approach, and show that the graph-based strategy: 1) is considerably faster, and 2) produces consistently more reliable annotations.",
author = "Daniele Pighin and Llu{\'i}s Formiga and Lluis Marques",
year = "2012",
language = "English",
booktitle = "AMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas",
publisher = "Association for Machine Translation in the Americas",

}

TY - GEN

T1 - A graph-based strategy to streamline translation quality assessments

AU - Pighin, Daniele

AU - Formiga, Lluís

AU - Marques, Lluis

PY - 2012

Y1 - 2012

N2 - We present a detailed analysis of a graphbased annotation strategy that we employed to annotate a corpus of 11,292 real-world English to Spanish automatic translations with relative (ranking) and absolute (adequate/nonadequate) quality assessments. The proposed approach, inspired by previous work in Interactive Evolutionary Computation and Interactive Genetic Algorithms, results in a simpler and faster annotation process. We empirically compare the method against a traditional, explicit ranking approach, and show that the graph-based strategy: 1) is considerably faster, and 2) produces consistently more reliable annotations.

AB - We present a detailed analysis of a graphbased annotation strategy that we employed to annotate a corpus of 11,292 real-world English to Spanish automatic translations with relative (ranking) and absolute (adequate/nonadequate) quality assessments. The proposed approach, inspired by previous work in Interactive Evolutionary Computation and Interactive Genetic Algorithms, results in a simpler and faster annotation process. We empirically compare the method against a traditional, explicit ranking approach, and show that the graph-based strategy: 1) is considerably faster, and 2) produces consistently more reliable annotations.

UR - http://www.scopus.com/inward/record.url?scp=84992397169&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84992397169&partnerID=8YFLogxK

M3 - Conference contribution

BT - AMTA 2012 - Proceedings of the 10th Conference of the Association for Machine Translation in the Americas

PB - Association for Machine Translation in the Americas

ER -