AI & MLCoreAIML-LM-018
Perplexity
The standard intrinsic measure of a language model: exponentiated average negative log-likelihood per token.
- Difficulty
- 2 / 5
- Importance
- 5 / 5
- Study time
- 1–2 h
- Kind of work
- Mixed
Why it matters
The learner can compute perplexity from per-token probabilities and explain why it depends on the tokenizer.