Stack Exchange network consists of 183 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.
@NawafBou-Rabee : The graph G is G(V,E). The set of vertices V form the domain of Markov chain. I am using the usual correspondence: The transition matrix of the markov chain is given by the adjacency matrix of the graph.