Suppose that $M$ is a time-homogeneous (and, for simplicity, stationary) Markov chain on $d$ states, which induces the probability measure $P$ on paths of length $n$. I seek a Markov chain $M'$ on $d'<d$ states whose induced distribution $P'$ on paths of length $n$ minimizes $\epsilon:=||P-P'||_1$. What is known about the optimal relations between $d,d',n,\epsilon$? Update: As Bill Bradley notes below, we'll need some conditions on $M$, such as ergodicity, for anything nontrivial to be possible at all. Update II: As pointed out elsewhere, an earthmover-type distance (such as Wasserstein) probably makes more sense than TV on distributions over different domains.