TOPICS
Search

Stationary Distribution


A stationary distribution of a Markov chain with transition matrix P is a vector of probabilities pi satisfying

 pi^TP=pi^T.

If the initial state has distribution pi, then every later state has the same distribution. Thus a stationary distribution is a left eigenvector of P with eigenvalue 1, normalized to have nonnegative entries summing to 1.

For a Markov chain on a general state space, a probability measure pi is stationary when pi(A)=intP(x,A)pi(dx) for every measurable set A, where P(x,A) is the transition probability from x into A. The Bak-Sneppen model provides an example on the continuous state space [0,1]^N (Alberts et al. 2017).

A finite Markov chain in which every state is reachable from every other has a unique stationary distribution with all entries positive. Convergence to it from every initial distribution additionally requires that the greatest common divisor of the possible state-return times be 1.

For a continuous-time Markov process on a finite state space, let Q_(ij)=k_(ij) for i!=j and Q_(ii)=-sum_(j!=i)k_(ij), where k_(ij) is the transition rate from state i to state j. The stationary-distribution equation becomes

 pi^TQ=0.

The detailed balance conditions are sufficient for either stationary-distribution equation, but are not necessary.


See also

Detailed Balance, Markov Chain, Minimum Entropy Production Principle, Mixing Time, Transition Matrix

Explore with Wolfram|Alpha

References

Alberts, T.; Lee, G. Y.; and Simper, M. "Bak-Sneppen Backwards." Stochastics 89, 1127-1142, 2017. https://doi.org/10.1080/17442508.2017.1282957.Norris, J. R. Markov Chains. Cambridge, England: Cambridge University Press, 1997.

Cite this as:

Weisstein, Eric W. "Stationary Distribution." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/StationaryDistribution.html

Subject classifications