Welcome to MathOverflow

Question

0

1

I'm looking for a measure to analysis the uncertainty observed in a set of variables (with multivariate Gaussian distribution). So, I've tried conventional Shanon entropy (differential entropy) which results into the following equation for MVG distributions:

H(s) = ln(sqrt((2πe)^k*det(cov)))

H(s) = 0.5*[k*ln(2πe)+sum(log(eigs))]

Where, Sigma(Σ) is the covariance matrix. Thus, it's just a constant term plus sum of logarithm of eigenvalues of covariance matrix. But, when I've a small eigenvalue among eigenvalues, the small value affects the whole thing dramatically. In other words, this measure is not robust to small eigenvalues. On the other hand if I use sum of eigenvalues itself (instead of logarithmic scales), I won't face this issue. I was wondering if there is any other measures of uncertainty which may result in to sum of eigs instead of sum of log(eigs)?

edited Sep 29 2011 at 0:35

David White
4,860●1●20●27

asked Sep 14 2011 at 20:39

Soroosh
5●2

Since this was already on the front-page, I retagged with some ArXiV tags – David White Sep 29 2011 at 0:36

psd · Accepted Answer · 2011-09-14 22:53:30Z UTC

-1

I was wondering if there is any other measures of uncertainty which may result in to sum of eigs instead of sum of log(eigs)?

This is also known as the "total variance" and is the sum of the diagonals of the covariance matrix.

answered Sep 14 2011 at 22:53

psd
221●1●5

Is this "total variance" measure used as a measure of uncertainty in literature? – Soroosh Sep 14 2011 at 23:14

Robust entropy-like measure for analyzing uncertainity

Remember to vote up questions/answers you find interesting or helpful (requires 15 reputation points)

1 Answer

You can accept an answer to one of your own questions by clicking the check mark next to it. This awards 15 reputation points to the person who answered and 2 reputation points to you.