Assume we have two sampling process, i.e. we can draw samples from two (not explicitly known) distributions P and Q. Is there any simple way to calculate the KLdivergence D(PQ)? P and Q could be discrete or continuous.
Take the 2minute tour
×
MathOverflow is a question and answer site for professional mathematicians. It's 100% free, no registration required.
The whole paper here is on that topic 

