User carnivorous mushroom

4 Actions

comment

Entropy inequality

@cardinal: thanks, what the type theory really suggests is the inequality $H(P)+D(P||Q)\geq H(P)$, which is a trivial consequence of $D(P||Q)\geq0$.

Apr 10, 2015 at 20:14

comment

Entropy inequality

Actually the hint of cardinal provides a trivial counterexample. I will have to check my intuition about types, it must obviously be wrong.

Apr 10, 2015 at 20:04

awarded

Student

Apr 10, 2015 at 17:25

asked

Entropy inequality

Apr 10, 2015 at 16:38

Loading…