The rate-distortion function of a source is the least asymptotic coding rate permitting an expected distortion at most . For a memoryless source
with a specified single-letter distortion
, it is characterized by
where
is mutual information and the logarithm base
determines the information unit. For bits, logarithms have base 2. The infimum ranges
over conditional distributions of a reconstruction
,
rather than over a prescribed class of linear encoders.
For a Bernoulli source of parameter with Hamming distortion,
for
and
for
. Here
is binary information entropy. The restriction to a linear
encoder in linear source coding changes this
tradeoff.