The score function
is the partial derivative of the log-likelihood
function
,
where
is the standard likelihood function.
For independent observations with densities
, the likelihood
function
|
(1)
|
gives
|
(2)
|
and thus that
|
(3)
| |||
|
(4)
| |||
|
(5)
|
Using the above formulation of , one can easily compute various statistical measurements associated
with
.
For example, the mean of
is denoted
, where
denotes the expectation
value of
.
Under regularity assumptions, including parameter-independent
support and justification of differentiation
under the integral, this expectation
value is zero and the variance equals the Fisher
information matrix (a scalar for a scalar parameter). Without these assumptions the identity can
fail. For a uniform observation on
, the score is
almost everywhere,
so its expectation value is
and its variance is zero.
The score function has extensive uses in many areas of mathematics, both pure and
applied, and is a key component of the field of likelihood theory.