TOPICS
Search

Fisher's Criterion


Fisher's criterion is an objective function used to choose a linear transformation to one dimension that separates two classes of multivariate observations. Let the class sample means be mu_1 and mu_2, and let S_W be the sum of the two within-class scatter matrices. For a nonzero vector w, the criterion is the ratio

 J(w)=([w^T(mu_1-mu_2)]^2)/(w^TS_Ww).

The numerator is the squared separation between the class means after projection, and the denominator is the within-class scatter after projection. The criterion is unchanged when w is multiplied by a nonzero scalar. When S_W is a nonsingular matrix, every maximizing direction is proportional to

 w=S_W^(-1)(mu_1-mu_2).

Using any such direction for the projection gives a Fisher linear discriminant.


See also

Fisher Linear Discriminant, Linear Transformation, Nonsingular Matrix, Sample Mean

Explore with Wolfram|Alpha

References

Fisher, R. A. "The Use of Multiple Measurements in Taxonomic Problems." Ann. Eugenics 7, 179-188, 1936. https://doi.org/10.1111/j.1469-1809.1936.tb02137.x.

Cite this as:

Weisstein, Eric W. "Fisher's Criterion." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/FishersCriterion.html

Subject classifications