TOPICS
Search

Overdetermined System


An overdetermined system is a system of equations containing more equations than unknowns. In the linear case it has the form Ax=b, where A is an m×n matrix with m>n.

An overdetermined system need not be inconsistent. For example, x=1 and 2x=2 have the common solution x=1, whereas x=1 and x=2 have none. In general, a linear overdetermined system has an exact solution iff b belongs to the column space of A. When an exact solution does not exist, the least squares fitting problem minimizes the squared Euclidean norm

 ||Ax-b||_2^2.

If the columns of A are linearly independent, the solution obtained by least squares fitting is unique and satisfies the normal equations. A QR decomposition provides a method for finding this solution without explicitly forming A^TA in the real case.


See also

Column Space, Least Squares Fitting, Linear System of Equations, Normal Equation, QR Decomposition, Underdetermined System

Explore with Wolfram|Alpha

References

Trefethen, L. N. and Bau, D. III. "Least Squares Problems." Lecture 11 in Numerical Linear Algebra. Philadelphia, PA: SIAM, 1997.

Cite this as:

Weisstein, Eric W. "Overdetermined System." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/OverdeterminedSystem.html

Subject classifications