Probability

EXPLORE THIS TOPIC IN the MathWorld Classroom

Probability is the branch of mathematics that studies the possible outcomes of given events together with the outcomes' relative likelihoods and distributions. In common usage, the word "probability" is used to mean the chance that a particular event (or set of events) will occur expressed on a linear scale from 0 (impossibility) to 1 (certainty), also expressed as a percentage between 0 and 100%. The analysis of events governed by probability is called statistics.

There are several competing interpretations of the actual "meaning" of probabilities. Frequentists view probability simply as a measure of the frequency of outcomes (the more conventional interpretation), while Bayesians treat probability more subjectively as a statistical procedure that endeavors to estimate parameters of an underlying distribution based on the observed distribution.

A properly normalized function that assigns a probability "density" to each possible outcome within some interval is called a probability density function (or probability distribution function), and its cumulative value (integral for a continuous distribution or sum for a discrete distribution) is called a distribution function (or cumulative distribution function).

A variate is defined as the set of all random variables that obey a given probabilistic law. It is common practice to denote a variate with a capital letter (most commonly X). The set of all values that X can take is then called the range, denoted R_X (Evans et al. 2000, p. 5). Specific elements in the range of X are called quantiles and denoted x, and the probability that a variate X assumes the element x is denoted P(X=x).

Probabilities are defined to obey certain assumptions, called the probability axioms. Let a sample space contain the union ( union ) of all possible events E_i, so

 S=( union _(i=1)^NE_i),
(1)

and let E and F denote subsets of S. Further, let F^'=not-F be the complement of F, so that

 F union F^'=S.
(2)

Then the set E can be written as

 E=E intersection S=E intersection (F union F^')=(E intersection F) union (E intersection F^'),
(3)

where  intersection denotes the intersection. Then

P(E)=P(E intersection F)+P(E intersection F^')-P[(E intersection F) intersection (E intersection F^')]
(4)
=P(E intersection F)+P(E intersection F^')-P[(F intersection F^') intersection (E intersection E)]
(5)
=P(E intersection F)+P(E intersection F^')-P(emptyset intersection E)
(6)
=P(E intersection F)+P(E intersection F^')-P(emptyset)
(7)
=P(E intersection F)+P(E intersection F^'),
(8)

where emptyset is the empty set.

Let P(E|F) denote the conditional probability of E given that F has already occurred, then

P(E)=P(E|F)P(F)+P(E|F^')P(F^')
(9)
=P(E|F)P(F)+P(E|F^')[1-P(F)]
(10)
P(A intersection B)=P(A)P(B|A)
(11)
=P(B)P(A|B)
(12)
P(A^' intersection B)=P(A^')P(B|A^')
(13)
P(E|F)=(P(E intersection F))/(P(F)).
(14)

The relationship

 P(A intersection B)=P(A)P(B)
(15)

holds if A and B are independent events. A very important result states that

 P(E union F)=P(E)+P(F)-P(E intersection F),
(16)

which can be generalized to

 P( union _(i=1)^nA_i)=sum_(i)P(A_i)-sum^'_(ij)P(A_i intersection A_j)+sum^('')_(ijk)P(A_i intersection A_j intersection A_k)-...+(-1)^(n-1)P( intersection _(i=1)^nA_i).
(17)

Wolfram Web Resources

Mathematica »

The #1 tool for creating Demonstrations and anything technical.

Wolfram|Alpha »

Explore anything with the first computational knowledge engine.

Wolfram Demonstrations Project »

Explore thousands of free applications across science, mathematics, engineering, technology, business, art, finance, social sciences, and more.

Computerbasedmath.org »

Join the initiative for modernizing math education.

Online Integral Calculator »

Solve integrals with Wolfram|Alpha.

Step-by-step Solutions »

Walk through homework problems step-by-step from beginning to end. Hints help you try the next step on your own.

Wolfram Problem Generator »

Unlimited random practice problems and answers with built-in Step-by-step solutions. Practice online or make a printable study sheet.

Wolfram Education Portal »

Collection of teaching and learning tools built by Wolfram education experts: dynamic textbook, lesson plans, widgets, interactive Demonstrations, and more.

Wolfram Language »

Knowledge-based programming for everyone.