Skip to main content
1 of 6
Jeff
  • 482
  • 2
  • 8

Maximizing mutual information between two linearly projected random variables

Consider discrete random variable $X$ with finite support $\mathcal{X}$, continuous random variable $Y$ with bounded support $\mathcal{Y}$ , and constants $c_1 ,c_2 \in \mathbb{R}$. Let $p_{XY}(X,Y)$ be the probability measure on $\mathcal{X} \times \mathcal{Y}$. Define $H(X,Y)$ and $H(Y|X)$ as the joint and conditional entropies. Define $Z = c_1 X_1 + c_2 X_2$ where $X_1$ nd $X_2$ are i.i.d. realizations from the probbaility measure on $X$. What are $c_1,c_2$ that maximize $H(Y, X)-H(Y|RX)$?

Jeff
  • 482
  • 2
  • 8