Skip to main content
added 105 characters in body
Source Link
Federico Poloni
  • 20.2k
  • 2
  • 82
  • 120

Just use a backward stable algorithmYou are essentially using normal equations to solve the least-squares problem $\min \|W^{1/2}(Ax-b)\|_2$ resulting from IRLS. For instanceNormal equations are known not to be a backward stable algorithm. Use other standard algorithms for LS problems instead, uselike the QR factorization or the SVD of $W^{1/2}A$, instead of forming normal equations like you. Those are doing hereguaranteed to be backward stable.

Just use a backward stable algorithm to solve the least-squares problem $\min \|W^{1/2}(Ax-b)\|_2$ resulting from IRLS. For instance, use the QR factorization or the SVD of $W^{1/2}A$, instead of forming normal equations like you are doing here.

You are essentially using normal equations to solve the least-squares problem $\min \|W^{1/2}(Ax-b)\|_2$ resulting from IRLS. Normal equations are known not to be a backward stable algorithm. Use other standard algorithms for LS problems instead, like the QR factorization or the SVD of $W^{1/2}A$ instead. Those are guaranteed to be backward stable.

Source Link
Federico Poloni
  • 20.2k
  • 2
  • 82
  • 120

Just use a backward stable algorithm to solve the least-squares problem $\min \|W^{1/2}(Ax-b)\|_2$ resulting from IRLS. For instance, use the QR factorization or the SVD of $W^{1/2}A$, instead of forming normal equations like you are doing here.