Nonlinear regression is a regression model in which the response is expressed as a function that is nonlinear in the unknown parameter vector
. For observations
, nonlinear least squares
fitting estimates
by minimizing
Unlike linear regression, minimization generally requires an iterative method, and the shape of the objective function can produce multiple local minima.