For the Gaussian case $I(X,Y)=f( \varrho )$ where $\varrho $ is the correlation coefficient, and $f$ is a known increasing function. Is there any known joint distribution where the $f$ is not strictly increasing, so for big values of $\varrho $ the $I(X,Y)$ might be small. Is there any way to construct such a distribution by applying a transformation on a random variable and by using a known distribution?

  • $\begingroup$ I can come up with a mixture of Gaussians example, but that wouldn't be very elegant... $\endgroup$
    – Memming
    Apr 19, 2016 at 15:29
  • $\begingroup$ I would like to see it. Even a family of pmfs that has this property ( for the discrete case ) might be interesting. $\endgroup$
    – Cauchy
    Apr 19, 2016 at 15:38
  • $\begingroup$ I mean, it's not difficult to have high MI while CC is 0. Last row of en.wikipedia.org/wiki/… should give you some ideas. Sorry, too busy today to give you a detailed example. $\endgroup$
    – Memming
    Apr 19, 2016 at 22:28


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.