|
The matrix decomposition of a square matrix into so-called
eigenvalues and eigenvectors is an extremely important one. This decomposition generally
goes under the name "matrix
diagonalization." However, this moniker is less than optimal, since the
process being described is really the decomposition of a matrix into a product of
three other matrices, only one of which is diagonal, and also because all other standard
types of matrix decomposition
use the term "decomposition" in their names, e.g., Cholesky decomposition, Hessenberg decomposition, and so on. As a result, the decomposition
of a matrix into matrices composed of its eigenvectors and eigenvalues is called
eigen decomposition in this work.
Assume has nondegenerate eigenvalues
and corresponding linearly independent eigenvectors which can be denoted
![[x_(11); x_(12); |; x_(1k)],[x_(21); x_(22); |; x_(2k)],...[x_(k1); x_(k2); |; x_(kk)].](/images/equations/EigenDecomposition/NumberedEquation1.gif) |
(1)
|
Define the matrices composed of eigenvectors
![P=[X_1 X_2 ... X_k]=[x_(11) x_(21) ... x_(k1); x_(12) x_(22) ... x_(k2); | | ... |; x_(1k) x_(2k) ... x_(kk)]](/images/equations/EigenDecomposition/NumberedEquation2.gif) |
(2)
|
and eigenvalues
![D=[lambda_1 0 ... 0; 0 lambda_2 ... 0; | | ... |; 0 0 ... lambda_k],](/images/equations/EigenDecomposition/NumberedEquation3.gif) |
(3)
|
where is a diagonal matrix. Then
giving the amazing decomposition of into a similarity transformation involving and ,
 |
(11)
|
The fact that this decomposition is always possible for a square matrix as long as is a square
matrix is known in this work as the eigen decomposition theorem.
Furthermore, squaring both sides of equation (11)
gives
By induction, it follows that for general positive integer powers,
 |
(15)
|
The inverse of is
where the inverse of the diagonal matrix is trivially given by
![D^(-1)=[lambda_1^(-1) 0 ... 0; 0 lambda_2^(-1) ... 0; | | ... |; 0 0 ... lambda_k^(-1)].](/images/equations/EigenDecomposition/NumberedEquation6.gif) |
(18)
|
Equation (◇) therefore holds for negative as well as positive.
A further remarkable result involving the matrices and follows from the
definition of the matrix exponential
Since is a diagonal matrix,
so can be found using
![D^n=[lambda_1^n 0 ... 0; 0 lambda_2^n ... 0; | | ... |; 0 0 ... lambda_k^n].](/images/equations/EigenDecomposition/NumberedEquation7.gif) |
(27)
|
|