A Bayes classifier is a classification rule that applies the Bayes decision rule. Given probabilities under a posterior
distribution for classes
, ...,
and a loss function
, where
is the numerical penalty for choosing action
when the true class is
, the Bayes classifier chooses an action
that minimizes the posterior expected loss
For a zero-one loss function, this is equivalent to choosing the class having largest such probability,