56
$\begingroup$

Is there a relationship between the eigenvalues of individual matrices and the eigenvalues of their sum? What about the special case when the matrices are Hermitian and positive definite?

I am investigating this with regard to finding the normalized graph cut under general convex constraints. Any pointers will be very helpful.

$\endgroup$
55
$\begingroup$

The problem of describing the possible eigenvalues of the sum of two hermitian matrices in terms of the spectra of the summands leads into deep waters. The most complete description was conjectured by Horn, and has now been proved by work of Knutson and Tao (and others?) - for a good discussion, see the Notices AMS article by those two authors

Depending on what you want, there should be simpler results giving estimates on the eigenvalues of the sum. A book like Bhatia's Matrix Analysis might have some helpful material.

$\endgroup$
36
$\begingroup$

A simple estimate which is often useful is that, if $A$ and $B$ are Hermitian matrices with eigenvalues $a_1 > a_2 > \ldots > a_n$ and $b_1 > b_2 > \ldots > b_n$ and the eigenvalues of the sum are $c_1 > c_2 > \ldots > c_n$, then $$ c_{i+j-1} \le a_i + b_j \quad\text{and}\quad c_{n-i-j} \ge a_{n-i} + b_{n-j}. $$ The above conditions are necessary but not sufficient for $A+B=C$ to have a solution; see the Knutson-Tao article if you want sufficient conditions.

If you do not impose that $A$ and $B$ are Hermitian then there are very few restrictions besides the trace being equal. More specifically, the $3n$-tuples $(a_1, \ldots, a_n, b_1, \ldots, b_n, c_1, \ldots, c_n)$ which occur as eigenvalues of $(A,B,C)$ with $A+B=C$ are dense in the hyperplane $\sum a_i + \sum b_i = \sum c_i$.

$\endgroup$
  • $\begingroup$ Can you give a reference to your two inequalities ? $\endgroup$ – Sandeep Silwal Jan 7 '18 at 3:28
13
$\begingroup$

If 2 positive matrices commute, than each eigenvalue of the sum is a sum of eigenvalues of the summands. This would be true more generally for commuting normal matrices. For arbitrary positive matrices, the largest eigenvalue of the sum will be less than or equal to the sum of the largest eigenvalues of the summands.

$\endgroup$
  • $\begingroup$ Can you give a reference? $\endgroup$ – David Spivak Apr 16 '16 at 1:58
  • $\begingroup$ @DavidSpivak: Commuting normal matrices are simultaneously diagonalizable. This is a version of the "spectral theorem." The link below is to lecture notes that look like a good reference, but if not, or that link dies, googling some of the terms spectral theorem commuting normal matrices should help. math.drexel.edu/~foucart/TeachingFiles/F12/M504Lect2.pdf $\endgroup$ – Jonas Meyer Jun 24 '16 at 20:17
5
$\begingroup$

If M is Hermitian then H + aI is positive semidefinite when a is large enough. So the Hermitian + positive semidefinite case is essentially the same as the Hermitian case

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.