Assume we have two sampling process, i.e. we can draw samples from two (not explicitly known) distributions P and Q. Is there any simple way to calculate the KL-divergence D(P||Q)? P and Q could be discrete or continuous.
The whole paper here is on that topic
Maybe this link is more stable? http://eceweb.ucsd.edu/~gert/papers/isit_2010.pdf