All Questions
Tagged with eigenvector markov-chains
5 questions
8
votes
2
answers
748
views
Lower bound on the entries of the Perron vector
Let $A$ be a matrix that satisfies all the conditions of Perron- Frobenius theorem. From the theorem it is known that the entries of the eigenvector corresponding to the largest eigenvalue will be ...
4
votes
0
answers
299
views
Stationary distribution of mixture of Markov Chain with "complete" Markov Chain
I already asked this question in StackExchange, but found little attention. So I'm just going to copy-paste my original question here.
Let $P$ be a stochastic matrix (of an irreducible Markov Chain) ...
2
votes
0
answers
701
views
Simple random walk on a discrete torus - the eigensystem, reference
My problem concerns finding a reference in which the formulae for the eigenvalues and the corresponding eigenvectors ($n$ linearly independent eigenvectors!) for the transition matrix of a simple ...
2
votes
1
answer
912
views
How can I efficiently approximate the stationary distribution of an infinite CTMC with a sparse rate matrix?
I am looking for methods to approximate the stationary distribution of an infinite CTMC with a sparse rate matrix. Each row and column of the rate matrix has a finite number of non-zero elements. ...
1
vote
1
answer
160
views
Optimum control of a probabilistic automaton
Suppose we have a probabilistic automaton and we assign a weight to each state. An "interaction strategy" would be a fixed map from states to inputs. Any interaction strategy could be used to ...