Skip to main content

All Questions

Filter by
Sorted by
Tagged with
19 votes
5 answers
18k views

Time-inhomogeneous Markov chains

I'm trying to find out what is known about time-inhomogeneous ergodic Markov Chains where the transition matrix can vary over time. All textbooks and lecture notes I could find initially introduce ...
markov-imitator's user avatar
7 votes
1 answer
391 views

Idempotent splitting for Markov kernels

Let $X$ be a standard Borel space and $e : X \to X$ a Markov kernel. Suppose that $e$ is idempotent, that is $e \circ e = e$, or written out using the Chapman-Kolmogorov equation, $$e(A|x) = \int_X e(...
Tobias Fritz's user avatar
  • 6,406