Skip to main content

All Questions

4 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4 votes
0 answers
91 views

What is the entropy of binomial decay?

Let's play a game. I start with $N$ indistinguishable tokens, and I wait $T$ turns. Every turn, each token has probability $p$ of disappearing. I want an analytic formula for the entropy of this ...
Andrew's user avatar
  • 141
2 votes
0 answers
69 views

A distribution $\pi \propto \exp(-f)$ satisfies log-Sobolev inequality, does $\exp(-af)$ also satisfy LSI?

Assume a distribution $\pi \propto e^{-f}$ satisfies log-Sobolev inequality (LSI) $$\forall \rho \in P(\mathbb{R}^n), \quad KL(\rho\| \pi) \le \frac{1}{2\lambda} I(\rho \| \pi)$$ with LSI constant $\...
JIaojiao Fan's user avatar
2 votes
0 answers
264 views

Prove or disprove a mutual information inequality

I have $n$ IID Bernoulli random variables denoted by $X_1,X_2,\ldots X_n$ with parameter $p$. I am interested in knowing if the following inequality involving mutual information holds : $\boxed{\max_{...
wanderer's user avatar
1 vote
0 answers
146 views

Using maximum entropy principle for joint probability estimation

Let $X_1, \dots, X_n, Y$ be random variables, each taking values in $\{0,1\}$. Assume that we are interested in estimating, for each $v=(v_1,\dots,v_n)\in \{0,1\}^n$, the probability $$ p(v) = P[Y=1|...
Bogdan Grechuk's user avatar