most recent 30 from http://mathoverflow.net 2013-06-18T22:40:34Z http://mathoverflow.net/feeds/question/37015 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/37015/why-is-beta-the-maximum-entropy-distribution-over-bernoullis-parameter Neil 2010-08-29T02:29:21Z 2010-11-22T15:40:04Z

<p>Why is Beta(1,1) the maximum entropy distribution over the bias of a coin expressed as a probability given that:</p> <ul> <li><p>If we express the bias as odds (which is over the support $[0, \infty)$), then Beta-prime(1,1) is the corresponding distribution to Beta(1,1). Isn't the maximum entropy distribution over the positive reals the exponential distribution (which is not Beta-prime(1,1))?</p></li> <li><p>If we express the bias in log odds (which is over the support of the reals), then the logistic distribution (with mean 0 and scale 1) is the corresponding distribution to Beta(1,1).</p></li> </ul> <p>Beta(1,1) makes sense as maximum entropy because it's flat over its support. The other distributions are not flat. If we had chosen a different parametrization, we should clearly arrive at the corresponding distribution (not something else). How are the other two distributions the maximum entropy distributions over their support? There must be some other requirement that I'm missing. What is it?</p>

http://mathoverflow.net/questions/37015/why-is-beta-the-maximum-entropy-distribution-over-bernoullis-parameter/37027#37027 R Hahn 2010-08-29T06:14:47Z 2010-08-29T06:14:47Z

<p>I think there are two separate things going on here. One is the issue of a maximum entropy distribution. The other is of whether or not distributions are invariant under different parameterizations. Regarding the second matter, I think your statement "if we had chosen a different parameterization, we should clearly arrive at the corresponding distribution" is probably not quite right (I say probably because I may be interpreting you wrong). Only particular distributions have this property and sometimes are not probability distributions. See <a href="http://en.wikipedia.org/wiki/Jeffreys_prior" rel="nofollow">http://en.wikipedia.org/wiki/Jeffreys_prior</a> if this is what you're interested in. </p> <p>ps I'd have preferred to leave this as a comment, but can't yet I guess.</p>

http://mathoverflow.net/questions/37015/why-is-beta-the-maximum-entropy-distribution-over-bernoullis-parameter/46960#46960 ternary 2010-11-22T15:40:04Z 2010-11-22T15:40:04Z

<p>Here's the Jeffreys paper: <a href="http://ifile.it/niok3wy/jeffreys-an_invariant_form-1946.pdf" rel="nofollow">http://ifile.it/niok3wy/jeffreys-an_invariant_form-1946.pdf</a></p>