TOPICS
Search

Fisher Information


The Fisher information in an observation X about a scalar parameter theta is the variance of the score function. If X has probability density function f(x;theta), it is

 I(theta)=E_(theta)[(partial/(partialtheta)lnf(X;theta))^2].

Under regularity conditions that permit differentiation under the integral sign, this can also be written as

 I(theta)=-E_(theta)[(partial^2)/(partialtheta^2)lnf(X;theta)].

Fisher information is additive for independent observations. Thus, n independent observations from the same distribution have information nI(theta). The reciprocal of the information gives the Cramér-Rao bound on the variance of an unbiased estimator under corresponding regularity conditions.


See also

Cramér-Rao Bound, Fisher Information Matrix, Likelihood Function, Score Function, Variance

Explore with Wolfram|Alpha

References

Fisher, R. A. "Theory of Statistical Estimation." Proc. Cambridge Philos. Soc. 22, 700-725, 1925. https://doi.org/10.1017/S0305004100009580.

Cite this as:

Weisstein, Eric W. "Fisher Information." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/FisherInformation.html

Subject classifications