All Questions
1 question with no upvoted or accepted answers
2
votes
0
answers
440
views
Hitting time of a specific Markov chain using martingale approach (or otherwise)
Let $0 < c < 1$. Consider the Markov chain $(X_i)$ on $\{0, 1, \dots, n\}$, with transition probabilities
$$ P(k,k+1) = \left(1 - \tfrac {k}{n} \right)(1-c), \quad k = 0, \dots, n-1, $$
$$ P(k,...
- 985