• Cite Icon1
  • https://doi.org/10.3115/1072133.1072194Copy DOI Icon

Is that your final answer?

  • Jan 1, 2001
  • Florence Reeder
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The purpose of this research is to test the efficacy of applying automated evaluation techniques, originally devised for the evaluation of human language learners, to the output of machine translation (MT) systems. We believe that these evaluation techniques will provide information about both the human language learning process, the translation process and the development of machine translation systems. This, the first experiment in a series of experiments, looks at the intelligibility of MT output. A language learning experiment showed that assessors can differentiate native from non-native language essays in less than 100 words. Even more illuminating was the factors on which the assessors made their decisions. We tested this to see if similar criteria could be elicited from duplicating the experiment using machine translation output. Subjects were given a set of up to six extracts of translated newswire text. Some of the extracts were expert human translations, others were machine translation outputs. The subjects were given three minutes per extract to determine whether they believed the sample output to be an expert human translation or a machine translation. Additionally, they were asked to mark the word at which they made this decision. The results of this experiment, along with a preliminary analysis of the factors involved in the decision making process will be presented here.

Similar Papers
  • Research Article

Editing Taiwan divination Verses with controlled Language Strategies: Machine-Translation-Mediated Effective Communication

  • Jan 01, 2020
  • Journal of Foreign Languages, Cultures and Civilizations
  • Chung-Ling Shih
  • Research Article
  • Citations1

Fine-tuning machine translation quality-rating scales for new digital genres: The case of user-generated content

  • Jul 19, 2022
  • ELUA
  • Miguel A Candel-Mora
  • PDF
  • Research Article
  • Citations11

Teaching Arabic Machine Translation to EFL Student Translators: A Case Study of Omani Translation Undergraduates

  • Feb 05, 2020
  • International Journal of English Linguistics
  • Yasser Muhammad Naguib Sabtan
  • Research Article
  • Citations14

Human-Computer Interaction in Translation Activity: Fluency of Machine Translation

  • Dec 15, 2021
  • RUDN Journal of Psychology and Pedagogics
  • Katarina Welnitzova +2
  • PDF
  • Conference Article
  • Citations2

Investigating the Helpfulness of Word-Level Quality Estimation for Post-Editing Machine Translation Output

  • Jan 01, 2021
  • Raksha Shenoy +3
  • Conference Article
  • Citations33

A Simple and Effective Approach to Automatic Post-Editing with Transfer Learning

  • Jan 01, 2019
  • Gonçalo M Correia +1
  • Supplementary Content

Preference Learning for Machine Translation

  • Jan 01, 2018
  • heiDOK (Heidelberg University)
  • Patrick Simianer
  • Supplementary Content
  • Citations6

Potential and limits of using post-edits as reference translations for MT evaluation

  • May 30, 2016
  • Arrow@dit (Dublin Institute of Technology)
  • Maja Popović +2
  • PDF
  • Research Article
  • Citations36

Machine Translation in the Field of Law: A Study of the Translation of Italian Legal Texts into German

  • Mar 01, 2019
  • Comparative Legilinguistics
  • Eva Wiesmann
  • PDF
  • Research Article
  • Citations25

Machine Translation of Noun Phrases from Arabic to English Using Transfer-Based Approach

  • Mar 01, 2010
  • Journal of Computer Science
  • Shirko
  • PDF
  • Research Article
  • Citations74

Identifying the Machine Translation Error Types with the Greatest Impact on Post-editing Effort

  • Aug 02, 2017
  • Frontiers in Psychology
  • Joke Daems +3
  • Research Article
  • Citations242

Statistical Approaches to Computer-Assisted Translation

  • Mar 01, 2009
  • Computational Linguistics
  • Sergio Barrachina +10
  • PDF
  • Research Article
  • Citations4

SuVashantor: English to Bangla Machine Translation Systems

  • Aug 01, 2020
  • Journal of Computer Science
  • Mahjabeen Akter +3
  • Book Chapter
  • Citations6

Re-engineering Machine Translation Systems through Symbiotic Approach

  • Jan 01, 2010
  • Pawan Kumar +4
  • Research Article
  • Citations1

‘Webbish writing’ for global communication in the Web 3.0

  • Dec 31, 2018
  • The Journal of Internationalization and Localization
  • Chung-Ling Shih
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.