1
$\begingroup$

Consider a markov chain with finite space { 0,1,..n} with transition probability matrix whose entries are $P_{ij}$. Let

$f_{ij}^n$ = probability that starting from state $i $ it goes to state $j$ first time.

Question 1. What are the necessary and sufficient condition arbitrary $a_{ij}^{n}$ needs to satisfy to be valid $f_{ij}^{n}$ of some markov chain ?

Qustion 2. If existence of such a markov chain is shown, can we calculate $P_{ij}$ given valid $f_{ij}^n$ ? ( I mean, is there any algorithm to calculate?)

$\endgroup$
1
  • $\begingroup$ Does the answer below correspond to what you were asking for? $\endgroup$
    – Did
    Apr 11, 2011 at 17:27

1 Answer 1

3
$\begingroup$

Re 2, for $n=1$, $P_{ij}=f^1_{ij}$ for every $i\ne j$ and $1-P_{ii}$ is the sum of $f^1_{ij}$ over $j\ne i$, hence one recovers trivially $P$ from $f^1=(f^1_{ij})_{ij}$.

Re 2 again, on the contrary, there is no hope to recover $P$ from $f^n=(f^n_{ij})_{ij}$ in general, for any given $n\ge2$. For example, the two (deterministic) one-step rotations on the discrete circle with $2n$ vertices, clockwise and counterclockwide, yield the same matrix $f^n$ although their transition matrices $P$ are different.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.