[Date Prev][Date Next][Thread Prev][Thread Next][Chronological Index][Thread Index]

Re: A possible metric for Machine Translation?

Hi M, 

At 1:59 PM +0200 9/4/98, Maghi King wrote:
>So I was wondering if there might not be some feature (quality
>subcharacteristic in ISO jargon) of MT systems that was just a minimal
>indicator of quality, was pertinent to most applications/uses of MT and
>could be tested relatively easily.
>One that springs to mind is preservation of truth values. 

That is, for an input sentence meaning 
  "This sentence is an incorrect translation" 
the following translation 
  "Sentence this one incorrect conversion changing been" 
is better than 
  "This sentence is a correct translation" 
because its truth value polarity is the same as the original?  

There are probably a dozen plausible "minimal indicators" one could choose, 
each one with a strong case.  

I think translation evaluation is simply not reducible to a single metric.  


Eduard Hovy
email: hovy@isi.edu          USC Information Sciences Institute 
tel: 310-822-1511 ext 731    4676 Admiralty Way 
fax: 310-823-6714            Marina del Rey, CA 90292-6695 
project homepage: http://www.isi.edu/natural-language/nlp-at-isi.html