Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 12518
5 votes

What does the KL being symmetric tell us about the distributions?

One example where this happens is when $P$ and $Q$ are "antipodal" distributions -- say, $p=(p_1,\ldots,p_n)$, $q=(q_1,\ldots,q_n)$, $q_i=1-p_i$, and $$P=\mathrm{Ber}(p_1)\times\mathrm{Ber}(p_2)\time …
Aryeh Kontorovich's user avatar