1
$\begingroup$

I'm stuck trying to find the maximum entropy probability distribution taking into account a joint distribution. Basically, I want to find the maximum entropy expression for $p(x,y)$ when the marginal distributions $p(x)$ and $p(y)$ are known.

Improve this question
$\endgroup$

1 Answer 1

Reset to default
2
$\begingroup$

Well $H(X,Y)\leq H(X)+H(Y)$ with equality if and only if $X$ and $Y$ are independent. So pick $p(x,y)=p(x)p(y).$

Improve this answer
$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .