Automatic Metrics Can Outperform Crowd Workers in Machine Translation Evaluation

New Google research compares machine translation evaluation by crowd workers and translator-trained automatic metrics.