1
$\begingroup$

Can someone help me with the following problem:

Let $P_n$ and $Q_n$ two multinomial laws with parameters $(p,n)$ and $(q,n)$, where $p$ and $q$ are two probability measures on some measurable space and $n\in \mathbb{N}$. Is it true that $\|P_n-Q_n\|_{TV}$ is non decreasing in $n$? I think that it is, but I cannot prove it...

Thank you.

Alainty

$\endgroup$
1
  • $\begingroup$ @SergueiPopov, Alainty it seems I did misunderstand the question so i deleted my answer. $\endgroup$
    – usul
    Sep 19, 2016 at 23:32

1 Answer 1

2
$\begingroup$

Assume both measures put positive probability on all outcomes. The total variation distance can be written $E_Q|1-\frac {dP_n}{dQ_n}|$. The likelihood ratio is a martingale, so the integrand is a submartingale and so it's expectation is increasing.

$\endgroup$
2
  • $\begingroup$ Ok, right! Thank you very much michael!! $\endgroup$
    – Alainty
    Sep 20, 2016 at 13:52
  • 1
    $\begingroup$ This is essentially correct, but there might be some confusion between the product measures $p^n$ and $q^n$, and the multinomial measures that are their projections. The reason the proof works is that a symmetry argument shows that the total variation distance is not changed by the projection. Working directly with the multinomial measures would require a proof of the Martingale property since the corresponding $\sigma$ fields are not increasing. $\endgroup$ Sep 23, 2016 at 17:39

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.