TOPICS
Search

Importance Sampling


Importance sampling is a Monte Carlo method which samples from an alternative probability density function and reweights the observations to estimate an expectation under the target statistical distribution. If the target and sampling probability density functions are p and q, respectively, the estimator is

 mu^^=1/nsum_(i=1)^nf(X_i)(p(X_i))/(q(X_i)),

where the X_i are independent and identically distributed with density q. If q(x)>0 wherever f(x)p(x)!=0 and f is integrable under p, this is an unbiased estimator of mu=intf(x)p(x)dx (Owen 2013). A well-chosen q can reduce the variance, but an inappropriate choice can increase it.


See also

Monte Carlo Integration, Monte Carlo Method, Unbiased Estimator

Explore with Wolfram|Alpha

References

Owen, A. B. "Importance Sampling." Ch. 9 in Monte Carlo Theory, Methods and Examples. 2013. https://artowen.su.domains/mc/Ch-var-is.pdf.

Cite this as:

Weisstein, Eric W. "Importance Sampling." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/ImportanceSampling.html

Subject classifications