Skip to content
ai

BLEU

Bilingual Evaluation Understudy

Definition

BLEU is an automatic metric for evaluating machine-generated text quality by measuring n-gram overlap with human reference translations. It was originally designed for machine translation and ranges from 0 to 1, with higher scores indicating closer match to reference text.

BLEU is widely criticized for correlating poorly with human judgment on open-ended generation tasks.

Can this ship? Are we exposed? Can you prove it?

Every CISO is asking these three questions. We answer them with facts, not guesses, from repository to runtime.