TOPICS
Search

Gaussian Mixture Model


A Gaussian mixture model is a mixture distribution whose component distributions are normal distributions. Its probability density function has the form

 f(x)=sum_(j=1)^kpi_jphi(x;mu_j,Sigma_j),

where pi_j>=0, sum_(j)pi_j=1, and phi is the probability density function of a multivariate normal distribution with mean mu_j and covariance matrix Sigma_j.

The component label is an unobserved categorical random variable. Model parameters are often estimated by alternately estimating component memberships and maximizing the resulting expected log likelihood function. A Gaussian mixture can be unimodal or multimodal, depending on its weights, means, and covariance matrices.

Okahara and Kobayashi (2026) proved that a mixture of three normal distributions with positive weights and a common positive definite covariance matrix has at most four modes in every dimension d>=2, and that four is attained. If the whitened means are collinear or form a right triangle or obtuse triangle, the sharp maximum is three. The result includes degenerate modes. Okahara and Kobayashi (2026) report AI assistance with symbolic-check design and algebraic verification code.


See also

Multimodal Distribution, Normal Distribution

Explore with Wolfram|Alpha

References

McLachlan, G. and Peel, D. Finite Mixture Models. New York: Wiley, 2000.Okahara, R. and Kobayashi, K. "Three Homoscedastic Gaussian Components Have at Most Four Modes." 11 Oct 2026. https://arxiv.org/abs/2610.15369.

Cite this as:

Weisstein, Eric W. "Gaussian Mixture Model." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/GaussianMixtureModel.html

Subject classifications