Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 43088
5 votes
Accepted

Higher moments of information and Renyi entropy

Matthews, "Entropy and Higher Moments of Information", Journal of Universal Computer Science vol 16, nr. 5 (2010) which is available here, the authors introduce the higher moments of information of memoryless … They move from the Shannon entropy formalism to more general entropies in section 7. …
Avitus's user avatar
  • 326
6 votes
0 answers
206 views

$q$-deformations of fundamental equation of information and entropies

$q$-deformations of Shannon entropy Let $q\in\mathbb R-\{1\}$ and $x>0$. … x \ln_q \frac{1}{x}+ (1-x)\ln_q \frac{1}{1-x} $$ and the $q$-Rényi entropy $$R_q(x)= \ln e_q(S_q(x)). $$ Both $q$ entropies are deformations of Shannon entropy, as $$\lim_{q\rightarrow 1}S_q(x)=\lim …
Avitus's user avatar
  • 326