# Entropy of moments of integers

Let $$x \in \{0,1\}^n$$ be uniformly at random. What is an estimate for the entropy of moments, $$H(\sum_i x_i, \sum_i i\cdot x_i, \sum_i i^2\cdot x_i)$$ ?

$$H(.)$$ here is the Shannon entropy

• Can you edit the question to define your H term? – Matt Cuffaro Jun 8 at 1:44
• Thanks, fixed it. – Jumanji Jun 8 at 1:58
• Do you really want the entropy of the three-tuple $(\sum_i x_i, \sum_i i\cdot x_i, \sum_i i^2\cdot x_i),$, or do you want the entropy of each moment separately? – r.e.s. Jun 8 at 14:17
• Thanks. I needed it for the three-tuple, but any technique to estimate either would be insightful. – Jumanji Jun 8 at 17:12
• I would use a version of the central limit theorem. Your sum should be close to a multivariate normal random variable for large $n$. Most of the mass should be in a neighborhood of the mean of size roughly $\sqrt n$ in the $x$ direction. $n^{3/2}$ in the $y$ direction and $n^{5/2}$ in the $z$ direction. The entropy should therefore be something like $\frac 92\log n$. – Anthony Quas Jun 10 at 2:02