Skip to main content

All Questions

Filter by
Sorted by
Tagged with
8 votes
2 answers
748 views

Lower bound on the entries of the Perron vector

Let $A$ be a matrix that satisfies all the conditions of Perron- Frobenius theorem. From the theorem it is known that the entries of the eigenvector corresponding to the largest eigenvalue will be ...
4 votes
0 answers
299 views

Stationary distribution of mixture of Markov Chain with "complete" Markov Chain

I already asked this question in StackExchange, but found little attention. So I'm just going to copy-paste my original question here. Let $P$ be a stochastic matrix (of an irreducible Markov Chain) ...
2 votes
0 answers
701 views

Simple random walk on a discrete torus - the eigensystem, reference

My problem concerns finding a reference in which the formulae for the eigenvalues and the corresponding eigenvectors ($n$ linearly independent eigenvectors!) for the transition matrix of a simple ...
2 votes
1 answer
912 views

How can I efficiently approximate the stationary distribution of an infinite CTMC with a sparse rate matrix?

I am looking for methods to approximate the stationary distribution of an infinite CTMC with a sparse rate matrix. Each row and column of the rate matrix has a finite number of non-zero elements. ...
1 vote
1 answer
160 views

Optimum control of a probabilistic automaton

Suppose we have a probabilistic automaton and we assign a weight to each state. An "interaction strategy" would be a fixed map from states to inputs. Any interaction strategy could be used to ...