TOPICS
Search

Rate-Distortion Function


The rate-distortion function of a source is the least asymptotic coding rate permitting an expected distortion at most D. For a memoryless source X with a specified single-letter distortion d, it is characterized by

 R(D)=inf_(P_(Y|X):E[d(X,Y)]<=D)I(X;Y),

where I(X;Y) is mutual information and the logarithm base determines the information unit. For bits, logarithms have base 2. The infimum ranges over conditional distributions of a reconstruction Y, rather than over a prescribed class of linear encoders.

For a Bernoulli source of parameter 0<p<=1/2 with Hamming distortion, R(D)=h_2(p)-h_2(D) for 0<=D<=p and R(D)=0 for D>=p. Here h_2 is binary information entropy. The restriction to a linear encoder in linear source coding changes this tradeoff.


See also

Information Entropy, Linear Source Coding, Mutual Information

Explore with Wolfram|Alpha

References

Berger, T. Rate Distortion Theory: A Mathematical Basis for Data Compression. Englewood Cliffs, NJ: Prentice-Hall, 1971.Wu, Y. "Entropy of Bernoulli Measures Conditioned on Affine Subspaces and a Problem of Ancheta-Massey." 24 Aug 2026. https://arxiv.org/abs/2608.22837.

Cite this as:

Weisstein, Eric W. "Rate-Distortion Function." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/Rate-DistortionFunction.html

Subject classifications