TOPICS
Search

Gaussian Mixture Model


A Gaussian mixture model is a mixture distribution whose component distributions are normal distributions. Its probability density function has the form

 f(x)=sum_(j=1)^kpi_jphi(x;mu_j,Sigma_j),

where pi_j>=0, sum_(j)pi_j=1, and phi is the probability density function of a multivariate normal distribution with mean mu_j and covariance matrix Sigma_j.

The component label is an unobserved categorical random variable. Model parameters are often estimated by alternately estimating component memberships and maximizing the resulting expected log likelihood function. A Gaussian mixture can be unimodal or multimodal, depending on its weights, means, and covariance matrices.

Okahara and Kobayashi (2026) proved that a mixture of three normal distributions with positive weights and a common positive definite covariance matrix has at most four modes in every dimension d>=2, and that four is attained. If the whitened means are collinear or form a right triangle or obtuse triangle, the sharp maximum is three. The result includes degenerate modes. Okahara and Kobayashi (2026) disclose ChatGPT assistance with mathematical exploration, proposed arguments, code, and checks. The authors take responsibility for the mathematical content.


See also

Multimodal Distribution, Normal Distribution

Explore with Wolfram|Alpha

References

McLachlan, G. and Peel, D. Finite Mixture Models. New York: Wiley, 2000.Okahara, R. and Kobayashi, K. "Three Homoscedastic Gaussian Components Have at Most Four Modes." 11 Oct 2026. https://arxiv.org/abs/2610.15369.

Cite this as:

Weisstein, Eric W. "Gaussian Mixture Model." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/GaussianMixtureModel.html

Subject classifications