This question was previously posted on MSE.

This question might be easy but I am really stuck on it.

Let $M$ be compact metric space and $\mathcal B(M)$ the Borel $\sigma$-algebra of M. Consider the discrete-time Markov process, $$\mathbf{X} =\left(\Omega,\{\mathcal F_n\}_{n\in\mathbb N}, \{X_n\}_{n\in\mathbb N}, \{P_n\}_{n\in\mathbb N} , \{\mathbb P_x\}_{x\in M}\right), $$ with state space $(M,\mathcal B(M)$ (I am considering that $0\in\mathbb N$) i.e.

- $(\Omega,\mathcal F_n),$ is a filtered measurable space,
- $X_n:\Omega\to M$ is $\mathcal F_n$ measurable,
- $\mathbb P_x [X_0 = x] =1,$ for every $x\in M,$
- For every $0 \leq n \leq m \in \mathbb N,$ $f:M\to\mathbb R$ bounded measurable function, and $x\in M$ $$\mathbb E_x [f(X_{n+m}) \mid \mathcal F_n] = (P_m f)(X_n), \ \mathbb P_x\ \mathrm{a.s.}, $$ where $P_n$ is a transition function on $(M,\mathcal B(M)),$ i.e. a family of probability maps $P_n : M\times \mathcal B(M) \to [0,1],$ such that

- $P_0(x,\mathrm{d} y) = \delta_x(\mathrm{d}y),$
- $P_n(x,\cdot)$ is a Borel probability measure for every $x\in M.$
- For every $n,m \in \mathbb N$ and $A\in\mathcal B(M),$ $$P_{n+m}(x, A) = \int_{M} P_n(y,A) P_m(x,\mathrm{d} y). $$

Assume that $\mathbf{X}$ admits an ergodic stationary measure $\mu$ on $M,$ i.e. $$\int_{M} P_n(x,A) \mu(\mathrm d x) = \mu(A),\ \forall \ A\in\mathcal B(M), $$ and if $$P_1(x,A) = 1,\ \forall \ x \ \mu\text{-a.s.}\ \in A \Rightarrow \mu(A) = 0\ \text{or }1. $$

Question:I would like to know if under this setup we would have the following ergodic theorem. For every $f\in L^1(M,\mathcal B(M), \mu),$ we obtain $$ \lim_{n\to\infty} \frac{1}{n} \sum_{i=0}^{n-1}f (X_n(\omega)) = \int_{M} f(x)\mu(\mathrm{d} x),\ \forall\ \omega \text{-}\mathbb P\ \text{a.s.,} $$ where $\mathbb P(\mathrm{d} y) := \int_{M}\mathbb P_x (\mathrm{d} y) \mu(\mathrm{d} x).$

**Comments regarding my question**

Consider $\mathbf{X}$ being an ergodic Markov process (using the above notation). For every $n\in\mathbb N$ let us consider the projection map \begin{align*} \pi_n : M^{\mathbb N}&\to M\\ (x_m)_{m\in\mathbb N}&\mapsto x_n. \end{align*}

If we define (via Komolgorov extension Theorem) the Borel probability measure $P_\mu$ on $M^\mathbb N$ as the unique Borel probability, such that given $A_0,\ldots,A_n \in M,$ then $$P_{\mu}\left(\{\omega_n\}_{n\in\mathbb N} \in M^{\mathbb N}; x_i\in A_i, \ \forall \ i\in\{0,1,\ldots,n\}\right) = \int_{A_0}\int_{A_1} \ldots \int_{A_{n-1}} P_1(x_{n},A_n) P_1(x_{n-1},\mathrm{d}x_n) \ldots P_1(x_0,\mathrm{d} x_1) \mu(\mathrm{d}x_0). $$

We have that the shift \begin{align*} \theta: (M^{\mathbb N},\mathcal B(M^{\mathbb N}) , P_\pi)&\to (M^{\mathbb N},\mathcal B(M^{\mathbb N}),P_\pi) \\ (x_{n})_{n\in\mathbb N}&\to (x_{n+1})_{n\in\mathbb N}, \end{align*} is an ergodic dynamical system and we have that for every $f\in L^1(M,\mathcal B(M),\mu)$ $$\lim_{n\to\infty}\frac{1}{n}\sum_{i=0}^{n-1} f(\pi_i(\omega)) = \int_M f(x) \mu(\mathrm{d} x),\ \forall \ \omega\text{-}P_\pi\ a.s.. $$

How do I translate the information of the canonical process (the one above) to the original Markov process $\mathbf{X}$? For every $\omega \in \Omega$, we have that
$$ \left(X_n(\omega)\right)_{n\in\mathbb N}\in M^{\mathbb N}, $$

and
$$\pi_i\left(\left(X_n(\omega)\right)_{n\in\mathbb N}\right) = X_i(\omega).$$

But it is not clear that $$\lim_{n\to\infty}\frac{1}{n}\sum_{i=0}^{n-1} f( X_i(\omega) ) = \int_M f(x) \mu(\mathrm{d} x),\ \forall \ \omega\text{-}\mathbb P\ a.s., $$ where $\mathbb P (\mathrm{d} y) = \int_M \mathbb P_x(\mathrm{d} y) \mu(\mathrm{d}x), $ can anyone help me? Or simply provide a reference for this ergodic Markov chains result without considering the canonical space.