In Search of Better MT Evaluation Metric : Some Experiments

Date: May 22, 2007
Presenter: Abhaya Agarwal
Title: In Search of Better MT Evaluation Metric : Some Experiments

Abstract: Area of automatic metrics for MT Evaluation has seen a lot of
activity in last 4-5 years. Starting with BLEU, many such metrics have
been proposed over the years including METEOR, HTER and ROUGE. While
these metrics achieve good correlation with human judgments at the
system level, situation remains bleak at individual sentence level. In
this talk, I will talk about some work that we have been doing towards
developing metrics with improved correlation with human judgments at the
sentence level. I will present the current results and some possible
future directions.