MathematicsRecommendedMTH-NUMAN-279
Floating Point Arithmetic
machine epsilon, cancellation, catastrophic error
- Difficulty
- 4 / 5
- Importance
- 4 / 5
- Study time
- 7.5–13 h
- Kind of work
- Practice
Why it matters
The theory of computing accurate approximate solutions; bridges continuous mathematics to the digital computer.
Where it is used
Scientific computing, simulation, ML training loops, engineering analysis, financial pricing models.
How you know you have learned it
Produce working code/model + convergence/validation/error analysis.
Resources
- Numerical Analysis (Burden & Faires) — Burden & Faires Book
- Numerical Analysis (Burden & Faires) — Burden & Faires Book
- Numerical Recipes — Press, Teukolsky et al. Reference