An estimator is a rule that tells how to calculate an estimate based on the measurements contained in a sample. For example, the sample
 mean 
 is an estimator for the population mean 
.
The mean square error of an estimator  is defined by
| 
 
(1)
 
 | 
Let  be the estimator
 bias, then
| 
 
(2)
 
 | |||
| 
 
(3)
 
 | |||
| 
 
(4)
 
 | 
where  is the estimator variance.