Suppose that $M$ is a time-homogeneous (and, for simplicity, stationary) Markov chain on $d$ states, which induces the probability measure $P$ on paths of length $n$. I seek a Markov chain $M'$ on $d'<d$ states whose induced distribution $P'$ on paths of length $n$ minimizes $\epsilon:=||P-P'||_1$. What is known about the optimal relations between $d,d',n,\epsilon$?
Update: As Bill Bradley notes below, we'll need some conditions on $M$, such as ergodicity, for anything nontrivial to be possible at all.