AI & MLRecommendedAIML-SYS-001
Training vs Serving
Two regimes, flipped constraints: throughput-hungry training vs latency-bound serving.
- Difficulty
- 3 / 5
- Importance
- 4 / 5
- Study time
- 1–2 h
- Kind of work
- Mixed
Why it matters
The learner can contrast training and serving constraints and route a requirement to its regime.