AI & MLCoreAIML-TRF-009
Positional Encoding Schemes and RoPE
Absolute, learned, relative, and rotary encodings: how position enters attention scores.
- Difficulty
- 2 / 5
- Importance
- 5 / 5
- Study time
- 1–2 h
- Kind of work
- Mixed
Why it matters
The learner can explain how rotary embeddings make the query-key score depend only on relative offset.