Picture of Yee Wei Law

Singular value

by Yee Wei Law - Saturday, 11 March 2023, 3:16 PM
 

Singular values, like eigenvalues, are an intrinsic property of a matrix. Unsurprisingly, they can be defined in terms of eigenvalues:

Definition 1: Singular value [Ber09, Definition 5.6.1]

Suppose matrix has eigenvalues , where . Then, the singular values of are the nonnegative numbers:

Singular values can also be defined through the operation called singular value decomposition:

Definition 2: Singular value decomposition and singular values [Hog13, Sec. 5.6]

A singular value decomposition (SVD) of a matrix is the factorisation:

where , and are unitary.

The diagonal entries of , namely , are the singular values of .

The columns of are the left singular vectors of .

The columns of are the right singular vectors of .

References

[Ber09] D. R. Bernstein, Matrix Mathematics: Theory, Facts, and Formulas, 2nd ed., Princeton University Press, 2009.
[Hog13] L. Hogben (ed.), Handbook of Linear Algebra, 2nd ed., CRC Press, 2013. https://doi.org/10.1201/b16113.

» Math and physics (including quantum)