ai
Perplexity
Language Model Perplexity
Definition
Perplexity is a metric for evaluating language models that measures how well the model predicts a held-out text sample. It is the exponentiated average negative log-likelihood per token — lower perplexity indicates the model assigns higher probability to the test text.
Perplexity is a standard intrinsic evaluation metric but correlates imperfectly with downstream task performance.
Can this ship? Are we exposed? Can you prove it?
Every CISO is asking these three questions. We answer them with facts, not guesses, from repository to runtime.