Consolidation based speech translation

Chiori Hori, Bing Zhao, Stephan Vogel, Alex Waibel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

To alleviate the degradation of the performance of speech translation, this paper proposes a new approach to translate ASR results through consolidation which extracts meaningful phrases and remove redundant and irrelevant information caused by speaker's disfluency and recognition errors. The speech translation results via consolidation are partial translation and can not be directly compared with gold standards in which all words are translated. We would like to propose a new evaluation framework for partial translation by comparing with the most similar set of words extracted from a word network created by merging gradual summarization of the gold standard translation. Chinese broadcast news speech in RT04 were recognized, consolidated and then translated. The performance of MT results was evaluated using BLEU. We propose Information Preservation Accuracy (IPAccy) and Meaning Preservation Accuracy (MPAccy) for consolidation and consolidation-based MT.

Original languageEnglish
Title of host publication2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings
Pages380-385
Number of pages6
Publication statusPublished - 1 Dec 2007
Externally publishedYes
Event2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007 - Kyoto, Japan
Duration: 9 Dec 200713 Dec 2007

Other

Other2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007
CountryJapan
CityKyoto
Period9/12/0713/12/07

Fingerprint

Consolidation
Merging
Degradation

Keywords

  • Chinese broadcast news speech
  • Chinese-English translation
  • Machine translation
  • Speech consolidation

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Software
  • Artificial Intelligence

Cite this

Hori, C., Zhao, B., Vogel, S., & Waibel, A. (2007). Consolidation based speech translation. In 2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings (pp. 380-385). [4430142]

Consolidation based speech translation. / Hori, Chiori; Zhao, Bing; Vogel, Stephan; Waibel, Alex.

2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings. 2007. p. 380-385 4430142.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hori, C, Zhao, B, Vogel, S & Waibel, A 2007, Consolidation based speech translation. in 2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings., 4430142, pp. 380-385, 2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Kyoto, Japan, 9/12/07.
Hori C, Zhao B, Vogel S, Waibel A. Consolidation based speech translation. In 2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings. 2007. p. 380-385. 4430142
Hori, Chiori ; Zhao, Bing ; Vogel, Stephan ; Waibel, Alex. / Consolidation based speech translation. 2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings. 2007. pp. 380-385
@inproceedings{0bbfcb29f85d46758317a622ebd18503,
title = "Consolidation based speech translation",
abstract = "To alleviate the degradation of the performance of speech translation, this paper proposes a new approach to translate ASR results through consolidation which extracts meaningful phrases and remove redundant and irrelevant information caused by speaker's disfluency and recognition errors. The speech translation results via consolidation are partial translation and can not be directly compared with gold standards in which all words are translated. We would like to propose a new evaluation framework for partial translation by comparing with the most similar set of words extracted from a word network created by merging gradual summarization of the gold standard translation. Chinese broadcast news speech in RT04 were recognized, consolidated and then translated. The performance of MT results was evaluated using BLEU. We propose Information Preservation Accuracy (IPAccy) and Meaning Preservation Accuracy (MPAccy) for consolidation and consolidation-based MT.",
keywords = "Chinese broadcast news speech, Chinese-English translation, Machine translation, Speech consolidation",
author = "Chiori Hori and Bing Zhao and Stephan Vogel and Alex Waibel",
year = "2007",
month = "12",
day = "1",
language = "English",
pages = "380--385",
booktitle = "2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings",

}

TY - GEN

T1 - Consolidation based speech translation

AU - Hori, Chiori

AU - Zhao, Bing

AU - Vogel, Stephan

AU - Waibel, Alex

PY - 2007/12/1

Y1 - 2007/12/1

N2 - To alleviate the degradation of the performance of speech translation, this paper proposes a new approach to translate ASR results through consolidation which extracts meaningful phrases and remove redundant and irrelevant information caused by speaker's disfluency and recognition errors. The speech translation results via consolidation are partial translation and can not be directly compared with gold standards in which all words are translated. We would like to propose a new evaluation framework for partial translation by comparing with the most similar set of words extracted from a word network created by merging gradual summarization of the gold standard translation. Chinese broadcast news speech in RT04 were recognized, consolidated and then translated. The performance of MT results was evaluated using BLEU. We propose Information Preservation Accuracy (IPAccy) and Meaning Preservation Accuracy (MPAccy) for consolidation and consolidation-based MT.

AB - To alleviate the degradation of the performance of speech translation, this paper proposes a new approach to translate ASR results through consolidation which extracts meaningful phrases and remove redundant and irrelevant information caused by speaker's disfluency and recognition errors. The speech translation results via consolidation are partial translation and can not be directly compared with gold standards in which all words are translated. We would like to propose a new evaluation framework for partial translation by comparing with the most similar set of words extracted from a word network created by merging gradual summarization of the gold standard translation. Chinese broadcast news speech in RT04 were recognized, consolidated and then translated. The performance of MT results was evaluated using BLEU. We propose Information Preservation Accuracy (IPAccy) and Meaning Preservation Accuracy (MPAccy) for consolidation and consolidation-based MT.

KW - Chinese broadcast news speech

KW - Chinese-English translation

KW - Machine translation

KW - Speech consolidation

UR - http://www.scopus.com/inward/record.url?scp=44849139902&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=44849139902&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:44849139902

SP - 380

EP - 385

BT - 2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings

ER -