TOPICS
Search

Fisher Linear Discriminant


The Fisher linear discriminant is a linear transformation to one dimension used to separate two classes of multivariate observations. Let the class sample means be mu_1 and mu_2, and let S_W be the sum of the two within-class scatter matrices. Fisher's criterion chooses a nonzero vector w to maximize

 J(w)=([w^T(mu_1-mu_2)]^2)/(w^TS_Ww).

When S_W is a nonsingular matrix, every maximizing direction is proportional to

 w=S_W^(-1)(mu_1-mu_2).

The projected scalar w^Tx can then be compared with a threshold to classify an observation. The method is also called Fisher's linear discriminant and forms the two-class basis of linear discriminant analysis.


See also

Covariance Matrix, Linear Transformation, Nonsingular Matrix, Sample Mean

Explore with Wolfram|Alpha

References

Fisher, R. A. "The Use of Multiple Measurements in Taxonomic Problems." Ann. Eugenics 7, 179-188, 1936. https://doi.org/10.1111/j.1469-1809.1936.tb02137.x.

Cite this as:

Weisstein, Eric W. "Fisher Linear Discriminant." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/FisherLinearDiscriminant.html

Subject classifications