Skip to main content
MathOverflow

Return to Question

I seem unable to spell the word "for"!
Source Link
Mark Fischler
Mark Fischler
  • 1.2k
  • 6
  • 13

Given a Markov process among a (possibly infinite) set of states $S$, with possibly infinite depth (that is, the transition probabilities from $s_i \to s_j$ at time $t$ are permitted to depend not only on the state at time $t-1$ but also on all previous states). Say the initial state is $\sigma_0$ and for some specific infinite sequence of target states $\{\sigma_i\} | i \in \Bbb{N}$ it has been proven that frofor all $i$ and all possible paths leading to $\sigma_i$, state $\sigma_i$ almost surely transitions to state $\sigma_{i+1}$ in finite time.

Does that necessarily imply that the process will a.s. traverse the entire (possibly infinite) chain of target states? (Obviously, if the chain is infinite, we cannot ask firfor traversing the chain in a finite number of time steps.) Or if that implication does not hold, can you show a counterexample?

An example of this sort of problem is a depth-1 random walk on a 2-d grid, with the target chain $\sigma_i = (i,0)$. Here each state $\sigma_i$ a.s. reaches $\sigma_i+1$ (but the expected time of first transition is infinite). And it can be shown that in fact the process does visit each point in the chain sequentially, a.s. Of course, one example does not prove the implication!

Given a Markov process among a (possibly infinite) set of states $S$, with possibly infinite depth (that is, the transition probabilities from $s_i \to s_j$ at time $t$ are permitted to depend not only on the state at time $t-1$ but also on all previous states). Say the initial state is $\sigma_0$ and for some specific infinite sequence of target states $\{\sigma_i\} | i \in \Bbb{N}$ it has been proven that fro all $i$ and all possible paths leading to $\sigma_i$, state $\sigma_i$ almost surely transitions to state $\sigma_{i+1}$ in finite time.

Does that necessarily imply that the process will a.s. traverse the entire (possibly infinite) chain of target states? (Obviously, if the chain is infinite, we cannot ask fir traversing the chain in a finite number of time steps.) Or if that implication does not hold, can you show a counterexample?

An example of this sort of problem is a depth-1 random walk on a 2-d grid, with the target chain $\sigma_i = (i,0)$. Here each state $\sigma_i$ a.s. reaches $\sigma_i+1$ (but the expected time of first transition is infinite). And it can be shown that in fact the process does visit each point in the chain sequentially, a.s. Of course, one example does not prove the implication!

Given a Markov process among a (possibly infinite) set of states $S$, with possibly infinite depth (that is, the transition probabilities from $s_i \to s_j$ at time $t$ are permitted to depend not only on the state at time $t-1$ but also on all previous states). Say the initial state is $\sigma_0$ and for some specific infinite sequence of target states $\{\sigma_i\} | i \in \Bbb{N}$ it has been proven that for all $i$ and all possible paths leading to $\sigma_i$, state $\sigma_i$ almost surely transitions to state $\sigma_{i+1}$ in finite time.

Does that necessarily imply that the process will a.s. traverse the entire (possibly infinite) chain of target states? (Obviously, if the chain is infinite, we cannot ask for traversing the chain in a finite number of time steps.) Or if that implication does not hold, can you show a counterexample?

An example of this sort of problem is a depth-1 random walk on a 2-d grid, with the target chain $\sigma_i = (i,0)$. Here each state $\sigma_i$ a.s. reaches $\sigma_i+1$ (but the expected time of first transition is infinite). And it can be shown that in fact the process does visit each point in the chain sequentially, a.s. Of course, one example does not prove the implication!

Source Link
Mark Fischler
Mark Fischler
  • 1.2k
  • 6
  • 13

Does an infinite chain of a.s. eventual transitions between states necessarily implies a.s transitions along the whole chain?

Given a Markov process among a (possibly infinite) set of states $S$, with possibly infinite depth (that is, the transition probabilities from $s_i \to s_j$ at time $t$ are permitted to depend not only on the state at time $t-1$ but also on all previous states). Say the initial state is $\sigma_0$ and for some specific infinite sequence of target states $\{\sigma_i\} | i \in \Bbb{N}$ it has been proven that fro all $i$ and all possible paths leading to $\sigma_i$, state $\sigma_i$ almost surely transitions to state $\sigma_{i+1}$ in finite time.

Does that necessarily imply that the process will a.s. traverse the entire (possibly infinite) chain of target states? (Obviously, if the chain is infinite, we cannot ask fir traversing the chain in a finite number of time steps.) Or if that implication does not hold, can you show a counterexample?

An example of this sort of problem is a depth-1 random walk on a 2-d grid, with the target chain $\sigma_i = (i,0)$. Here each state $\sigma_i$ a.s. reaches $\sigma_i+1$ (but the expected time of first transition is infinite). And it can be shown that in fact the process does visit each point in the chain sequentially, a.s. Of course, one example does not prove the implication!