Gathering empirical data to evaluate MT from English to Portuguese

In this paper we report on an experiment to gather quality analyses from several people, with a view to identifying problems and reaching consensus over (machine) translation from English to Portuguese. We start the paper by showing how this project is part of a larger framework of evaluation campai...

Full description

Bibliographic Details
Main Author: Santos, Diana (author)
Other Authors: Maia, Belinda Mary Harper Sousa (author), Sarmento, Luís (author)
Format: book
Language:eng
Published: 2004
Subjects:
Online Access:http://hdl.handle.net/10216/23470
Country:Portugal
Oai:oai:repositorio-aberto.up.pt:10216/23470
Description
Summary:In this paper we report on an experiment to gather quality analyses from several people, with a view to identifying problems and reaching consensus over (machine) translation from English to Portuguese. We start the paper by showing how this project is part of a larger framework of evaluation campaigns for Portuguese, and suggest the need for amassing consensual (or at least compatible) opinions. We describe the various tools (Metra, Boomerang, and TrAva) developed and explain the experiment, its results, shortcomings and lessons learned. We then present CorTA, a corpus of evaluated translations (English original, and several automatic translations into Portuguese) and make some remarks on how to use it for translation evaluation.