Jump to ContentJump to Main Navigation
Show Summary Details
More options …

The Prague Bulletin of Mathematical Linguistics

The Journal of Charles University

2 Issues per year

Open Access
Online
ISSN
1804-0462
See all formats and pricing
More options …

Addicter: What Is Wrong with My Translations?

Daniel Zeman
  • Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics, Charles University in Prague
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ Mark Fishel / Jan Berka
  • Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics, Charles University in Prague
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ Ondřej Bojar
  • Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics, Charles University in Prague
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
Published Online: 2011-09-06 | DOI: https://doi.org/10.2478/v10108-011-0013-2

Addicter: What Is Wrong with My Translations?

We introduce Addicter, a tool for Automatic Detection and DIsplay of Common Translation ERrors. The tool allows to automatically identify and label translation errors and browse the test and training corpus and word alignments; usage of additional linguistic tools is also supported. The error classification is inspired by that of Vilar et al. (2006), although some of their higher-level categories are beyond the reach of the current version of our system. In addition to the tool itself we present a comparison of the proposed method to manually classified translation errors and a thorough evaluation of the generated alignments.

  • Banerjee, Satanjeev and Alon Lavie. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proc. of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pages 65-72, Ann Arbor, Michigan, 2005.Google Scholar

  • Birch, Alexandra and Miles Osborne. Reordering metrics for MT. In Proc. of ACL'11, pages 1027-1035, Portland, Oregon, USA, 2011.Google Scholar

  • Birch, Alexandra, Miles Osborne, and Phil Blunsom. Metrics for MT evaluation: Evaluating reordering. Machine Translation, 24(1):15-26, 2010.Google Scholar

  • Bojar, Ondřej. Analyzing Error Types in English-Czech Machine Translation. Prague Bulletin of Mathematical Linguistics, 95, 2011.Google Scholar

  • Bojar, Ondřej and Zdeněk Žabokrtský. CzEng 0.9: Large parallel treebank with rich annotation. Prague Bulletin of Mathematical Linguistics, 92:63-83, 2009.Google Scholar

  • Denkowski, Michael and Alon Lavie. Extending the METEOR Machine Translation Evaluation Metric to the Phrase Level. In Proc. of HLT-NAACL'10, pages 250-253, 2010.Google Scholar

  • Giménez, Jesús and Lluis Màrquez. Towards heterogeneous automatic MT error analysis. In Proc. of LREC'08, Marrakech, Morocco, 2008.Google Scholar

  • Liang, Percy, Ben Taskar, and Dan Klein. Alignment by agreement. In Proc. of HLT-NAACL'06, pages 104-111, New York City, USA, 2006.Google Scholar

  • Och, Franz Josef and Hermann Ney. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19-51, 2003.Google Scholar

  • Popović, Maja and Hermann Ney. Word error rates: decomposition over POS classes and applications for error analysis. In Proc. of WMT'07, pages 48-55, Stroudsburg, PA, USA, 2007.Google Scholar

  • Popović, Maja, Adrià de Gispert, Deepa Gupta, Patrik Lambert, Hermann Ney, José B. Mariño, Marcello Federico, and Rafael Banchs. Morpho-syntactic information for automatic error analysis of statistical machine translation output. In Proc. of WMT'06, pages 1-6, New York, USA, 2006.Google Scholar

  • Popović, Maja and Aljoscha Burchardt. From human to automatic error classification for machine translation output. In Proc. of EAMT'11, pages 265-272, Leuven, Belgium, 2011.Google Scholar

  • Stymne, Sara. Blast: A tool for error analysis of machine translation output. In Proc. of ACL-HLT'11, pages 56-61, Portland, Oregon, 2011.Google Scholar

  • Vilar, David, Jia Xu, Luis Fernando D'Haro, and Hermann Ney. Error analysis of machine translation output. In Proc. of LREC'06, pages 697-702, Genoa, Italy, 2006.Google Scholar

  • Vogel, Stephan, Hermann Ney, and Christoph Tillmann. HMM-based word alignment in statistical translation. In Proc. of COLING'96, pages 836-841, Copenhagen, Denmark, 1996.Google Scholar

  • Wong, Billy and Chunyu Kit. The parameter-optimized ATEC metric for MT evaluation. In Proc. of the Joint WMT'10 and MetricsMATR, pages 360-364, Uppsala, Sweden, 2010.Google Scholar

About the article


Published Online: 2011-09-06

Published in Print: 2011-10-01


Citation Information: The Prague Bulletin of Mathematical Linguistics, ISSN (Online) 1804-0462, ISSN (Print) 0032-6585, DOI: https://doi.org/10.2478/v10108-011-0013-2.

Export Citation

This content is open access.

Citing Articles

Here you can find all Crossref-listed publications in which this article is cited. If you would like to receive automatic email messages as soon as this article is cited in other publications, simply activate the “Citation Alert” on the top of this page.

[1]
Mirjam Sepesy Maučec and Janez Brest
Artificial Intelligence Review, 2017
[2]
Ângela Costa, Wang Ling, Tiago Luís, Rui Correia, and Luísa Coheur
Machine Translation, 2015, Volume 29, Number 2, Page 127
[3]
Débora Beatriz de Jesus Martins and Helena de Medeiros Caseli
Machine Translation, 2015, Volume 29, Number 1, Page 1

Comments (0)

Please log in or register to comment.
Log in