Given a Bayesian network and evidence for the values of a subset of the variables, a standard question is to compute the posterior distribution on the remaining variables. The Gibbs sampling technique gives a discrete time Markov chain which samples from this posterior distribution. Is there a continuous time Markov process which does the same thing?
Take the 2minute tour
×
MathOverflow is a question and answer site for professional mathematicians. It's 100% free, no registration required.
For any discrete time Markov chain, you can get a continuous time Markov chain with the same stationary measure: just perform the same transitions as the discrete time Markov chain, but at times given by a Poisson process. 

