Ching, Wai-Ki - 2013 - 2nd ed. 2013
. Chapter 1 gives a brief introduction to the classical theory on both discrete and continuous time Markov chains. The … relationship between Markov chains of finite states and matrix theory will also be highlighted. Some classical iterative methods …