AI & MLCoreAIML-NN-003
Activation Functions
The bend that makes depth matter: why linearity stacks flat, and sigmoid/ReLU/GELU roles.
- Difficulty
- 2 / 5
- Importance
- 5 / 5
- Study time
- 1–2 h
- Kind of work
- Mixed
Why it matters
The learner can explain why stacked linear layers collapse and contrast sigmoid, ReLU, and GELU shapes.