TOPICS
Search

Nonparametric Estimation


Nonparametric estimation is a statistical method that allows the functional form of a fit to data to be obtained in the absence of any guidance or constraints from theory. As a result, the procedures of nonparametric estimation have no meaningful associated parameters. Two types of nonparametric techniques are artificial neural networks and kernel estimation.

Artificial neural networks model an unknown function by expressing it as a weighted sum of several sigmoids, usually chosen to be logit curves, each of which is a function of all the relevant explanatory variables. This amounts to an extremely flexible functional form for which estimation requires a nonlinear least-squares iterative search algorithm based on gradients.

Kernel estimation specifies y=m(x)+e, where m(x) is the conditional expectation of y with no parametric form whatsoever, and the density of the error e is completely unspecified. The N observations y_i and x_i are used to estimate a joint density function for y and x. The density at a point (y_0,x_0) is estimated by seeing what proportion of the N observations are "close to" (y_0,x_0). This procedure involves the use of a function called a kernel to assign weights to nearby observations.


See also

Nonparametric Statistics

This entry contributed by Edgar van Tuyll

Explore with Wolfram|Alpha

References

Kennedy, P. A Guide to Econometrics, 5th ed. Cambridge, MA: MIT Press, 1998.Pagan, A. R. and Ullah, A. Non-Parametric Econometrics. Cambridge, England: Cambridge University Press, 1997.Scott, D. W. Multivariate Density Estimation: Theory, Practice and Visualization. New York: Wiley, 1992.

Referenced on Wolfram|Alpha

Nonparametric Estimation

Cite this as:

van Tuyll, Edgar. "Nonparametric Estimation." From MathWorld--A Wolfram Web Resource, created by Eric W. Weisstein. https://mathworld.wolfram.com/NonparametricEstimation.html

Subject classifications