MathOverflow is a question and answer site for professional mathematicians. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

The normal distribution on $\mathbb{R}$, the exponential distribution on $\mathbb{R}_{\geq 0}$, and the geometric distribution on $\mathbb{N}$ are examples of distributions that are both infinitely divisible and entropy maximizers. On the other hand, the Poisson distribution is an infinitely divisible distribution on $\mathbb{N}$ without maximizing entropy, while the uniform distribution on the interval $[a,b]$ maximizes entropy but is not infinitely divisible.

Can anything be said about the relationship between these two classes of distributions?

share|cite|improve this question
I don't see a-priori why there should be some intrinsic relationship between infinite divisibility and max-ent, but maybe i am missing some intuition here. – Suvrit Jun 18 '11 at 13:31
Doesn't the Poisson distribution maximize entropy with respect to the measure that assigns $1/n!$ to $\{n\}$ for $n \in \{0,1,2,\ldots\}$, among all measures on $\{0,1,2,\ldots\}$ having a given expected value? (BTW, a nice way to see istantly that the uniform distribution on $[0,1]$ is not infinitely divisible is that its fourth cumulant is negative. The even-degree cumulants of infinitely divisible distributions are non-negative.) – Michael Hardy Jun 19 '11 at 16:01

The Poisson distribution has maximum entropy under the condition of having a specific mean and being a sum of Bernoulli random variables. The condition of being a sum of Bernoulli random variables can be weakened to being ultra log-concave.

share|cite|improve this answer
Is this still true if one considers sums of integer multiples of Bernoulli random variables? – J. Fabian Meier Mar 28 '15 at 20:40

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.