The Least Squares Solution
The Least Squares Approximation is a examples-intensive concept. However, it can be solved using the following concise formulas:
for system
- $ A\bold{x}=\bold{b}, $
- $ {A^T(A\bold{\hat{x}} - \bold{b})} = 0, $
which is equivalent to
- $ {A^TA\bold{\hat{x}}} = A^{T}\bold{b}. $
NOTE:
Thorough examples are available in the MA265 textbook, Webassign problems, and Past Exam Archive. Most problems only deal with linear and parabolic fits.
Main Reference
Kolman, B., & Hill, D. (2007). Elementary linear algebra with applications (9th ed.). Prentice Hall.
Ryan Jason Tedjasukmana
Back to Inner Product Spaces and Orthogonal Complements