Skip to main content
1 of 3
Gerald Edgar
  • 41.1k
  • 5
  • 125
  • 219

This is a Markov chain in state-space $\mathbb R^n$. There is machinery to determine whether (and to what) it converges. You determine that a certain $n \times n$ matrix is "irreducible" and then you get convergence to the unique (up to scalar multiple) positive eigenvector with eigenvalue $1$. Goes back to Perron & Frobenius, I guess.

Gerald Edgar
  • 41.1k
  • 5
  • 125
  • 219