TOPICS
Search

Fixed Point Iteration


A fixed point iteration is an iterative method for approximating a fixed point p of a map g. Starting from an initial value x_0, it forms the sequence

 x_(n+1)=g(x_n),
(1)

for n=0, 1, 2, .... The method is also called successive approximation or Picard iteration (Picard 1894). If the sequence converges to p and g is continuous at p, then taking the limit in the iteration gives p=g(p). Convergence is not automatic and can depend strongly on both the map and the initial value.

Suppose (X,d) is a complete metric space and g:X->X is a contraction. If there is a constant q with 0<=q<1 such that

 d(g(x),g(y))<=qd(x,y),
(2)

for all x,y in X, the Banach fixed point theorem states that g has a unique fixed point p and that the fixed point iteration converges to p for every x_0 in X (Banach 1922). It also gives the a priori error bound

 d(x_n,p)<=q^nd(x_0,p)<=(q^n)/(1-q)d(x_1,x_0).
(3)

For n>=1, an a posteriori error bound is

 d(x_n,p)<=q/(1-q)d(x_n,x_(n-1)).
(4)

For a differentiable real or complex function, a fixed point p is locally attracting when |g^'(p)|<1 and repelling when |g^'(p)|>1. When 0<|g^'(p)|<1, convergence is generally linear with asymptotic error ratio |g^'(p)|. The problem of finding a root of f(x)=0 can be converted to fixed point form x=g(x), but different choices of g can have different convergence behavior (Schröder 1870). Newton's method, for example, is the fixed point iteration with g(x)=x-f(x)/f^'(x).

Fixed point iteration can be computed in the Wolfram Language using FixedPoint[g, x0]. The intermediate iterates are returned by FixedPointList[g, x0]. For example, iterating g(x)=cosx from x_0=1 converges to the Dottie number.


See also

Banach Fixed Point Theorem, Fixed Point, Iteration, Mann Iteration, Newton's Method, Picard's Existence Theorem

Explore with Wolfram|Alpha

References

Banach, S. "Sur les opérations dans les ensembles abstraits et leur application aux équations intégrales." Fund. Math. 3, 133-181, 1922. https://doi.org/10.4064/fm-3-1-133-181.Picard, E. "Sur la méthode des approximations successives et les équations différentielles linéaires." Bull. Soc. Math. France 22, 52-57, 1894. https://doi.org/10.24033/bsmf.481.Schröder, E. "Ueber unendlich viele Algorithmen zur Auflösung der Gleichungen." Math. Ann. 2, 317-365, 1870. https://doi.org/10.1007/BF01444024.

Cite this as:

Weisstein, Eric W. "Fixed Point Iteration." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/FixedPointIteration.html

Subject classifications