Precision is the number of significant digits carried in a numerical computation. In significance
arithmetic, a nonzero approximation with estimated absolute uncertainty
has decimal precision
.
Thus precision measures relative uncertainty, whereas accuracy
measures absolute uncertainty,
with
. These measures depend on the uncertainty
assigned to a number, not merely its displayed digits.
In many programming languages, numerical computations are done with some fixed precision.