Skip to main content
1 of 3
Cauchy
  • 153
  • 6

KL Divergence - Convolution of distributions

Assume $P_1,P_2,P_3$ pmfs. We would like to find an upper bound for $D_{\text{KL}}(P_1\ast P_3||P_2 \ast P_3)$. By using the log sum inequality we can get $D_{\text{KL}}(P_1\ast P_3||P_2 \ast P_3) \leq D_{\text{KL}}(P_1||P_2 )$. Is there any way to get a tighter bound?

Cauchy
  • 153
  • 6