Skip to main content

All Questions

Filter by
Sorted by
Tagged with
9 votes
1 answer
495 views

Higher moments of information and Renyi entropy

For a given discrete probability distribution, Shannon entropy can be though as an expectation value $\langle - \log p \rangle$ (see also: What is entropy, really?, What is the role of the logarithm ...
Piotr Migdal's user avatar
  • 1,612