Skip to main content

All Questions

Filter by
Sorted by
Tagged with
1 vote
1 answer
143 views

Comparison of hitting probability of two Markov chains both with only one absorbing state version 2 under stronger condition

Let $N_n:=\{1,2,\cdots,n\}$. Given two finite states Markov chains $\big(X^{(j)}_i\in N_n\}\big)_{i=0}^\infty$ for $j\in\{1,2\}$, both of which have two absorbing states at $1$ and $n$. $\text{Pr}\...
Hans's user avatar
  • 2,239
3 votes
0 answers
305 views

Nonlinear Markov process

Consider the following nonlinear $\mathbb{R}$-valued stochastic recursive sequence: $ X_{n+1} = F(X_n) + W_{n+1}, \quad (W_n)_{n\ge1} \stackrel{ \scriptsize \mathrm{i.i.d.} }{ \sim } \phi. $ How can ...
user47855's user avatar