Skip to main content

All Questions

Filter by
Sorted by
Tagged with
17 votes
4 answers
2k views

Geometric interpretations of the exponential of entropy

Question: Might there be a natural geometric interpretation of the exponential of entropy in Classical and Quantum Information theory? This question occurred to me recently via a geometric inequality ...
Aidan Rocke's user avatar
  • 3,871
2 votes
1 answer
280 views

How much can KL divergence decrease by diluting the reference distribution

Let $\Omega$ be a countable set and $\mu,\nu\colon\Omega\to[0,1]$ be distributions on $\Omega$, that is we have $\sum_{x\in\Omega}\mu(x)=1$ and likewise for $\nu$. The Kullback-Leibler divergence of $\...
boinkboink's user avatar