All Questions
1 question with no upvoted or accepted answers
1
vote
0
answers
336
views
Existence of solution for Poisson equation in Markov chain
Consider $X_n\in \mathcal{X}$ a controlled Markov chain taking value in a compact set $\mathcal{X}$ with action $a\in \mathcal{A}$, where the action set $|\mathcal{A}|$ is finite.
(In particular, we ...
- 185