TOPICS
Search

Score Function


The score function u(theta) is the partial derivative of the log-likelihood function F(theta)=lnL(theta), where L(theta) is the standard likelihood function.

For independent observations y_i with densities f_i(y_i|theta), the likelihood function

 L(theta)=product_(i=1)^nf_i(y_i|theta)
(1)

gives

 F(theta)=sum_(i=1)^nlnf_i(y_i|theta)
(2)

and thus that

u(theta)=partial/(partialtheta)F(theta)
(3)
=sum_(i=1)^(n)(partiallnf_i(y_i|theta))/(partialtheta)
(4)
=sum_(i=1)^(n)1/(f_i(y_i|theta))(partialf_i(y_i|theta))/(partialtheta).
(5)

Using the above formulation of u, one can easily compute various statistical measurements associated with u. For example, the mean of u(theta) is denoted E[u(theta)], where E[Y] denotes the expectation value of Y. Under regularity assumptions, including parameter-independent support and justification of differentiation under the integral, this expectation value is zero and the variance equals the Fisher information matrix (a scalar for a scalar parameter). Without these assumptions the identity can fail. For a uniform observation on (0,theta), the score is -1/theta almost everywhere, so its expectation value is -1/theta and its variance is zero. The score function has extensive uses in many areas of mathematics, both pure and applied, and is a key component of the field of likelihood theory.


See also

Derivative, Expectation Value, Fisher Information Matrix, Likelihood, Likelihood Function, Log-Likelihood Function, Logarithm, Partial Derivative, Probability, Variance

Portions of this entry contributed by Christopher Stover

Explore with Wolfram|Alpha

References

Rodriguez, G. "Lecture Notes on Generalized Linear Models." 2007. http://data.princeton.edu/wws509/notes/.Sun, D. and Xiao, F. "Likelihood Theory with Score Function." 2013. http://www.stats.uwo.ca/faculty/bellhouse/Likelihood_Theory_with_Score_Function.pdf.

Referenced on Wolfram|Alpha

Score Function

Cite this as:

Weisstein, Eric W., with contributions by Christopher Stover. "Score Function." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/ScoreFunction.html

Subject classifications