A theorem from information theory that is a simple consequence of the weak law of large numbers. It states that if a set of values , , ..., is drawn independently from a random variable distributed according to , then the joint probability satisfies

where is the entropy of the random variable .

This entry contributed by Erik G. Miller

More things to try:

Miller, Erik G. "Asymptotic Equipartition Property." From MathWorld--A Wolfram Web Resource, created by Eric W. Weisstein. https://mathworld.wolfram.com/AsymptoticEquipartitionProperty.html