Skip to main content

All Questions

Filter by
Sorted by
Tagged with
18 votes
3 answers
3k views

Entropy and total variation distance

Let $X$, $Y$ be discrete random variables taking values within the same set of $N$ elements. Let the total variation distance $|P-Q|$ (which is half the $L_1$ distance between the distributions of $P$ ...
H A Helfgott's user avatar
  • 20.2k
2 votes
0 answers
264 views

Prove or disprove a mutual information inequality

I have $n$ IID Bernoulli random variables denoted by $X_1,X_2,\ldots X_n$ with parameter $p$. I am interested in knowing if the following inequality involving mutual information holds : $\boxed{\max_{...
wanderer's user avatar