Skip to main content
1 of 3
Steve Flammia
  • 2.6k
  • 2
  • 25
  • 29

When are probability distributions completely determined by their moments?

If two different probability distributions have identical moments, are they equal? I suspect not, but I would guess they are "mostly" equal, for example, on everything but a set of measure zero. Does anyone know an example of two different probability distributions with identical moments? The less pathological the better.

And a related question: Suppose I ask the same question about Renyi entropies. Recall that the Renyi entropy is defined for all a ≥ 0 by

Ha(p) = log(Σj pja)/(1-a)

You can define a=0,1,∞ by taking suitable limits of this formula. Are two distributions with identical Renyi entropies (for all values of the parameter a) actually equal? How "rigid" is this result? If I allow two Renyi entropies of distributions p and q to differ by at most some small ε independent of a, then can I put an upper bound on, say, || p - q ||1 in terms of ε?

Steve Flammia
  • 2.6k
  • 2
  • 25
  • 29