TOPICS
Search

Singular Value Decomposition


The singular value decomposition of an m×n real matrix A is a factorization

 A=UDV^T.
(1)

In the full decomposition, U is an m×m orthogonal matrix, V is an n×n orthogonal matrix, and D is an m×n matrix with D_(ij)=0 for i!=j. Its entries D_(ii), 1<=i<=min(m,n), are the nonnegative singular values of A.

There are several notational conventions in use. A reduced decomposition uses p=min(m,n) and takes U to be m×p, D to be a p×p diagonal matrix, and V to be n×p. In either convention, the columns retained in U and V are orthonormal, so that

 U^TU=I
(2)

and

 V^TV=I
(3)

for the appropriate identity matrices (Golub and Van Loan 1996, pp. 70-71).

For a complex matrix A, the full singular value decomposition has the form

 A=UDV^H,
(4)

where U and V are unitary matrices, V^H is the conjugate transpose of V, and D again has nonnegative singular values in positions (i,i) and zero elsewhere. Such a decomposition exists for every real matrix or complex matrix, including rectangular matrices.

When A is the coefficient matrix of a vector in a tensor product of two Hilbert spaces, its singular value decomposition gives the Schmidt decomposition of that vector.

Singular value decomposition is implemented in the Wolfram Language as SingularValueDecomposition[m], which returns a list {U, D, V}. Here U, D, and V are matrices, and the only possibly nonzero entries of D are the singular values of m in positions (i,i).


See also

Cholesky Decomposition, Eigen Decomposition, Eigen Decomposition Theorem, Eigenvalue, Eigenvector, LU Decomposition, Matrix Decomposition, QR Decomposition, Schmidt Decomposition, Singular Value, Unitary Matrix

Explore with Wolfram|Alpha

References

Gentle, J. E. "Singular Value Factorization." §3.2.7 in Numerical Linear Algebra for Applications in Statistics. Berlin, Germany: Springer-Verlag, pp. 102-103, 1998.Golub, G. H. and Van Loan, C. F. "The Singular Value Decomposition" and "Unitary Matrices." §2.5.3 and 2.5.6 in Matrix Computations, 3rd ed. Baltimore, MD: Johns Hopkins University Press, pp. 70-71 and 73, 1996.Nash, J. C. "The Singular-Value Decomposition and Its Use to Solve Least-Squares Problems." Ch. 3 in Compact Numerical Methods for Computers: Linear Algebra and Function Minimisation, 2nd ed. Bristol, England: Adam Hilger, pp. 30-48, 1990.Press, W. H.; Flannery, B. P.; Teukolsky, S. A.; and Vetterling, W. T. "Singular Value Decomposition." §2.6 in Numerical Recipes in FORTRAN: The Art of Scientific Computing, 2nd ed. Cambridge, England: Cambridge University Press, pp. 51-63, 1992.

Referenced on Wolfram|Alpha

Singular Value Decomposition

Cite this as:

Weisstein, Eric W. "Singular Value Decomposition." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/SingularValueDecomposition.html

Subject classifications