TOPICS
Search

Cramér-Rao Bound


The Cramér-Rao bound, also called the Cramér-Rao inequality, is a lower bound on the variance of an unbiased estimator. For an unbiased estimator theta^^ of a scalar parameter theta, the bound is

 Var_(theta)(theta^^)>=1/(I(theta)),

where I(theta) is the Fisher information in the observations. More generally, if g^^ is an unbiased estimator of a differentiable function g(theta), then

 Var_(theta)(g^^)>=((g^'(theta))^2)/(I(theta)).

The inequalities require regularity conditions that justify differentiating expectations with respect to theta. They show that greater Fisher information permits a smaller variance, but they do not guarantee that an estimator attaining the bound exists.


See also

Estimator, Fisher Information, Unbiased Estimator, Variance

Explore with Wolfram|Alpha

References

Cramér, H. Mathematical Methods of Statistics. Princeton, NJ: Princeton University Press, 1946.Rao, C. R. "Information and Accuracy Attainable in the Estimation of Statistical Parameters." Bull. Calcutta Math. Soc. 37, 81-91, 1945.

Cite this as:

Weisstein, Eric W. "Cramér-Rao Bound." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/Cramer-RaoBound.html

Subject classifications