closed form expression for Rényi entropy for multivariate Gaussian distributions - MathOverflow most recent 30 from http://mathoverflow.net2013-05-22T21:46:33Zhttp://mathoverflow.net/feeds/question/75539http://www.creativecommons.org/licenses/by-nc/2.5/rdfhttp://mathoverflow.net/questions/75539/closed-form-expression-for-renyi-entropy-for-multivariate-gaussian-distributionsclosed form expression for Rényi entropy for multivariate Gaussian distributionsSoroosh2011-09-15T16:30:21Z2011-09-15T18:29:16Z
<p>Is there any closed form expression for Rényi entropy of a set variables with multivariate Gaussian distribution?</p>
http://mathoverflow.net/questions/75539/closed-form-expression-for-renyi-entropy-for-multivariate-gaussian-distributions/75550#75550Answer by Deane Yang for closed form expression for Rényi entropy for multivariate Gaussian distributionsDeane Yang2011-09-15T18:29:16Z2011-09-15T18:29:16Z<p>Yes. First, do a change of variable in the integral to convert it to the Renyi entropy of a set of uncorrelated Gaussians with standard deviation $1$. The integral now splits into a product of 1-dimensional integrals, where each one is the Renyi entropy of a 1-dimensional Gaussian.</p>
<p>An alternative approach is to write the integral in polar co-ordinates and split the integral into the product of a spherical integral (which is equal to something like the determinant of the covariance matrix multiplied by the volume of a sphere) and a radial integral. The radial integral can be written in terms of gamma functions (or, beta functions) using the right change of variable.</p>