Focusing on BLEU Can Bias Machine Translation Output

Carnegie Mellon University and Amazon researchers find beam search, which boosts BLEU scores, can lead to high rates of misgendered pronouns.