AI & MLCoreAIML-NN-018
Automatic Differentiation
How frameworks compute gradients: forward-mode vs reverse-mode accumulation over a recorded graph.
- Difficulty
- 2 / 5
- Importance
- 5 / 5
- Study time
- 1–2 h
- Kind of work
- Mixed
Why it matters
The learner can compare forward- and reverse-mode passes on a small graph and explain why reverse mode suits many-input, one-output losses.