Skip to main content
Tom's user avatar
Tom's user avatar
Tom's user avatar
Tom
  • Member for 8 years, 2 months
  • Last seen more than a month ago
comment
Gaussian-to-Gaussian transformations are affine a.e.?
Thanks! This basically satisfies my curiosity, so I'll mark it as resolved. One comment is that these references (and work cited-therein by Basu and Khatri (1969)) all assume the function is bijective. It isn't clear to me if this is necessary, and from a quick skim, the authors don't seem to remark on it.
awarded
Loading…
revised
Loading…
Loading…
revised
Loading…
comment
Maximization of information over set of non-injective functions (Equality)
My answer still works. X,Y,Z are pairwise independent in this construction.
Loading…
comment
Are the derivatives of the differential entropy power alternating?
I guess you might already know, but this is closely related to McKean's conjecture, a weak form of which speculates that the successive derivatives of $H(X_t)$ alternate in sign. See "Higher Order Derivatives in Costa’s Entropy Power Inequality" by Cheng and Geng, and references therein.
awarded
awarded
revised
Loading…
Loading…
revised
Loading…
Loading…
answered
Loading…
comment
Smallest $\mathrm{D}(Q\|P)$ given fixed marginals $\mathrm{D}(Q_X\|P_X)$ and $\mathrm{D}(Q_Y\|P_Y)$
to add to above, this equivalence does not actually make your problem any easier. It just converts from an entropy problem to an equivalent functional one. Except in special cases (e.g., where $P$ is product of rho-correlated Gaussians or Rademachers), a characterization of the extremizers is likely non-explicit. However, if $P$ is a product measure, you can use tensorization of Brascamp--Lieb inequalities (and their entropic equivalents) to conclude that the extremizers will also have product structure. You should also be able to see this directly.
comment
Smallest $\mathrm{D}(Q\|P)$ given fixed marginals $\mathrm{D}(Q_X\|P_X)$ and $\mathrm{D}(Q_Y\|P_Y)$
Regarding your first comment on hypercontractivity, you are mostly correct. This equivalence holds in a general sense. $P$ being $(1/a,1/b)$-hypercontractive is equivalent to the infimum of $𝐷(𝑄||𝑃)−𝑎𝐷(𝑄1||𝑃1)−𝑏𝐷(𝑄2||𝑃2)$ over all $Q$ being zero. More generally, the infimum of this problem will be nonzero, which by duality then corresponds to something like hypercontractivity, but with a prefactor in the norm inequality. See, e.g., page 22 here: arxiv.org/pdf/1702.06260.pdf, and references therein (in particular, Carlen and Cordero-Erausquin, 2009).