The quantum relative entropy of density matrices
and
on the same finite-dimensional Hilbert space is
provided the column space of is contained in the column space
of
. Otherwise its value is infinite. The matrix
trace is interpreted on the column space of
, with
.
This convention handles zero eigenvalues without applying
a logarithm to a singular matrix.
Quantum relative entropy is nonnegative and vanishes iff .
If the two density matrices commute, matrix
diagonalization in a common orthonormal basis
reduces it to classical relative entropy with
natural logarithms. It is neither symmetric
nor a metric (Watrous 2018).
For a joint density matrix , its quantum mutual
information is
,
where
and
are the reduced density matrices. This quantity
is the correction for final correlations in Landauer's
principle.