Numerical error
Jump to navigation
Jump to search
In software engineering and mathematics, numerical error is the error in the numerical computations.

Types
[edit | edit source]It can be the combined effect of two kinds of error in a calculation. The first is referred to as round-off error and is caused by the finite precision of computations involving floating-point numbers. The second, usually called truncation error, is the difference between the exact mathematical solution and the approximate solution obtained when simplifications are made to the mathematical equations to make them more amenable to calculation.
Measure
[edit | edit source]Floating-point numerical error is often measured in ULP (unit in the last place).
See also
[edit | edit source]- Loss of significance
- Numerical analysis
- Error analysis (mathematics)
- Round-off error
- Kahan summation algorithm
- Numerical sign problem
References
[edit | edit source]- Accuracy and Stability of Numerical Algorithms, Nicholas J. Higham, Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- "Computational Error And Complexity In Science And Engineering", V. Lakshmikantham, S.K. Sen, Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).