Solving quadratically constrained least squares problems using a differential-geometric approach

• A quadratically constrained linea least squares problem is usually solved using a Lagrange multiplier for the constraint and then solving iteratively a nonlinear secular equation for the optimal Lagrange multiplier. It is well-known that, due to the closeness to a pole for the secular equation, standard methods for solving the secular equation can be slow, and sometimes it is not easy to select a good starting value for the iteration. The problem can be reformulated as that of minimizing the residual of the least squares problem on the unit sphere. Using a differential-geometric approach we formulate Newton's method on the sphere, and thereby avoid the difficulties associated with the Lagrange multiplier formulation. This Newton method on the sphere can be implemented efficiently, and since it is easy to find a good starting value for the iteration, and the convergence is often quite fast, it has a clear advantage over the Lagrange multiplier method. A numerical example is given.

Keyword

ill-conditioned

Lagrange multiplier

least squares

Newton's method

quadratic constraint

Stiefel manifold

TECHNOLOGY

TEKNIKVETENSKAP

Publication and Content Type

ref (subject category)

art (subject category)