Skip to main content
4 of 7
added 141 characters in body
Carlo Beenakker
  • 188.1k
  • 18
  • 448
  • 651

Note that $A$ only appears in the combination $M=A-BC$, so the derivative with respect to $A$ equals the derivative with respect to $M$; The function $f(A)$ is given by $$f(A)=||(A - BC)^Nv - w||_2^2=(M^Nv)^T M^Nv+w^Tw-2w^TM^Nv.$$ For a simple case, let me first consider a scalar perturbation, $f(A+\epsilon I)=f(A)+\epsilon df/dA$, with derivative $$\frac{df}{dA} =2N(M^Nv-w)^TM^{N-1}v.$$

Next consider the derivative with respect to a given matrix element $A_{ij}$ of $A$. The expressions are more lengthy, basically each matrix $M$ gives a separate term so we have a sum $\sum_{k=1}^N$ instead of the factor $N$. It is convenient to denote the transpose by $M^T\equiv\tilde{M}$. We arrive at $$\frac{\partial f}{\partial A_{ij}}=2\sum_{k=1}^N(\tilde{M}^{k-1}M^N v)_i (M^{N-k} v)_j-2\sum_{k=1}^N (\tilde{M}^{k-1} w)_i (M^{N-k} v)_j.$$ Note that the scalar perturbation is the trace of the matrix of elementwise perturbations, $df/dA=\sum_{i=1}^n \partial f/\partial A_{ii}$.

Carlo Beenakker
  • 188.1k
  • 18
  • 448
  • 651