Unfortunately, the way the term "ergodic" is used in the theory of (finite) Markov chains is completely misleading from the point of view of general ergodic theory. To be consistent, one should have called "ergodic" the chains whose state space does not admit a decomposition into non-trivial non-communicating subsets. The notion of ergodicity you are referring to would rather correspond to what is called "mixing" in ergodic theory.
More precisely, an initial distribution $m$ of a Markov chain on a state space $X$ determines the associated measure $\mathbf P_m$ on the space of sample paths $X^{\mathbb Z_+}$. The measure $\mathbf P_m$ is shift invariant iff the measure $m$ is stationary. Now, if $m$ is finite (this condition is important; otherwise the following claim is false), then ergodicity of the time shift is equivalent to absence of non-trivial partitions of $X$ into non-communicating subsets.
By the way, your example is really too degenerate: the standard example for difference between ergodicity and mixing for Markov chains is presence of so-called periodic classes $A_1\to A_2\to\dots\to A_k\to A_1$ (the only allowed transitions are from $A_i$ to $A_{i+1}$ mod k). For finite chains this is actually the only reason for difference between ergodicity and mixing, but for general state spaces the situation is more complicated.

