Take the 2-minute tour ×
MathOverflow is a question and answer site for professional mathematicians. It's 100% free, no registration required.

The normal distribution on $\mathbb{R}$, the exponential distribution on $\mathbb{R}_{\geq 0}$, and the geometric distribution on $\mathbb{N}$ are examples of distributions that are both infinitely divisible and entropy maximizers. On the other hand, the Poisson distribution is an infinitely divisible distribution on $\mathbb{N}$ without maximizing entropy, while the uniform distribution on the interval $[a,b]$ maximizes entropy but is not infinitely divisible.

Can anything be said about the relationship between these two classes of distributions?

share|improve this question
    
I don't see a-priori why there should be some intrinsic relationship between infinite divisibility and max-ent, but maybe i am missing some intuition here. –  Suvrit Jun 18 '11 at 13:31
    
Doesn't the Poisson distribution maximize entropy with respect to the measure that assigns $1/n!$ to $\{n\}$ for $n \in \{0,1,2,\ldots\}$, among all measures on $\{0,1,2,\ldots\}$ having a given expected value? (BTW, a nice way to see istantly that the uniform distribution on $[0,1]$ is not infinitely divisible is that its fourth cumulant is negative. The even-degree cumulants of infinitely divisible distributions are non-negative.) –  Michael Hardy Jun 19 '11 at 16:01
add comment

1 Answer

The Poisson distribution is has maximum entropy under the condition of having a specific mean and being a sum of Bernoulli random variables. The condition of being a sum of Bernoulli random variables can weakend to being ultra log-concave.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.