minimize the sum of absolute eigenvalues - MathOverflow

minimize the sum of absolute eigenvalues

2010-06-08T21:07:38Z

Hi,

We have a real symmetric matrix M with diagonal elements 0's, the eigenvalues and eigenvectors of M are computed.

Now we wish to change its diagonal elements arbitrarily to minimize the sum of absolute eigenvalues. Does there exist a way to find such modifications?

If we add a constraint : keep Tr(M)=0, would that become easier?

Is there some topics about these?

Thank you for your help

Zhi Ming

Answer by Noah Stein for minimize the sum of absolute eigenvalues

2010-06-08T21:34:02Z

The sum of the absolute value of the eigenvalues is the same (since the matrix is real and symmetric) as the sum of the singular values. This sum is called the nuclear norm of the matrix. So what you are saying is that you have an affine space of matrices (a "matrix pencil") over which you would like to minimize the nuclear norm. This is the case whether you add the trace constraint or not.

This is a convex optimization problem. A google search for "nuclear norm" will show how this can be converted to a semidefinite program and solved that way. You'll also get results about more specialized interior point methods which are optimized for just this problem.

Answer by Ben for minimize the sum of absolute eigenvalues

2010-06-08T22:15:08Z

If it helps, here is code using Matlab and Yalmip:

n = 5;

%Random symmetric matrix
A = 10*rand(n,n);
A=A'*A;

%Zero on the diagonal
A(sub2ind([n n],1:n,1:n)) = 0;

X = sdpvar(n,n,'symmetric');

%Equal to A off the diagonal
C=[];
for i=1:n
    for j=i+1:n
        C = [C; set(X(i,j) == A(i,j))];
    end
end

%We can add this if we want
%C = [C; set(trace(X)==0)];

solvesdp( C, sumabsk(X,n));
X=double(X);

X
sum(abs(eig(X)))
A
sum(abs(eig(A)))

It performs the optimization you are asking for by recognizing it as an SDP and solving it.

Answer by rcompton for minimize the sum of absolute eigenvalues

2010-07-14T06:25:39Z

Interesting question. Nuclear norm minimization is getting much attention right now as it relates directly to compressed sensing.

Some software for minimization with this constraint that I've used: http://perception.csl.illinois.edu/matrix-rank/sample_code.html