Shannon's Noiseless Coding Theorem

Explore with Wolfram|Alpha

More things to try:

1/6 + 5/12 + 3/4
fixed necklaces with 6 beads and 3 colors
integrate sin x dx from x=0 to pi

References

Let

be an information source with entropy

. ThenH(S)<=m(S),where

is the minimum average code-word length among all uniquely decipherable coding schemes for

ReferencesCasti, J. L. "The Shannon Coding Theorem." Ch. 1 in Five More Golden Rules: Knots, Codes, Chaos, and Other Great Theories of 20th-Century Mathematics. New York: Wiley, pp. 207-254, 2000.