Amazingly, the distribution of a sum of two normally distributed independent variates and
with means and variances
and
, respectively is another normal distribution
(1)
|
which has mean
(2)
|
and variance
(3)
|
By induction, analogous results hold for the sum of normally distributed
variates.
An alternate derivation proceeds by noting that
(4)
| |||
(5)
|
where
is the characteristic function and
is the inverse Fourier transform, taken with
parameters
.
More generally, if is normally distributed
with mean
and variance
, then a linear function of
,
(6)
|
is also normally distributed. The new distribution has mean and variance
, as can be derived using the moment-generating
function
(7)
| |||
(8)
| |||
(9)
| |||
(10)
| |||
(11)
|
which is of the standard form with
(12)
| |||
(13)
|
For a weighted sum of independent variables
(14)
|
the expectation is given by
(15)
| |||
(16)
| |||
(17)
| |||
(18)
| |||
(19)
|
Setting this equal to
(20)
|
gives
(21)
| |||
(22)
|
Therefore, the mean and variance of the weighted sums of random variables are their
weighted sums.
If
are independent and normally
distributed with mean 0 and variance
,
define
(23)
|
where
obeys the orthogonality condition
(24)
|
with
the Kronecker delta. Then
are also independent and normally distributed with mean
0 and variance
.
Cramer showed the converse of this result in 1936, namely that if and
are independent
variates and
has a normal distribution, then both
and
must be normal. This result is known as Cramer's theorem.