Skip to main content

All Questions

Filter by
Sorted by
Tagged with
7 votes
1 answer
621 views

Does every (generalized?) Markov chain admit transition probabilities?

To pose the question let us start by recalling the following notions: Transition Probabilities. A transition probability matrix between two measurable spaces $(S,\mathcal{S})$ and $(V,\mathcal{V})$ ...
David's user avatar
  • 486
4 votes
1 answer
213 views

Practical way to check for geometric convergence

Target distribution is multimodal, 24 dimensions, continuous state space. For MCMC integration (MH sampler) I use a manually tuned proposal distribution. When I measure the convergence rate ...
Anton's user avatar
  • 101
0 votes
1 answer
205 views

Inhomogeneous Markov chains and the product-integral as a solution to the Kolmogorov forward equation

We have a inhomogeneous continous $K$-State Markov chain $X(t)$ with transition intensity matrix $Q(t)$. Therefore its entries are: $$q_{ij}(t)= \lim_{\delta \to 0} \frac{1}{\delta} \mathbb{P}(X(t+\...
Bloble's user avatar
  • 3