AI & MLRecommendedAIML-SYS-007
Inference at Scale
Serving under load: batching, bottlenecks, and reading a serving story.
- Difficulty
- 3 / 5
- Importance
- 4 / 5
- Study time
- 1–2 h
- Kind of work
- Mixed
Why it matters
The learner can locate the bottleneck in a tiny serving story and name the fix family.