AI & MLCoreAIML-ATT-005
Self-Attention
A sequence attending to itself: every token contextualized by weighted others.
- Difficulty
- 2 / 5
- Importance
- 5 / 5
- Study time
- 1–2 h
- Kind of work
- Mixed
Why it matters
The learner can select a query token and read its weights, mixture, and contextualized output.