“…iI . By substituting(23) into(10),(11) and(13) to(16) when m = M -It can be seen that the process of substitution can be continue to Equation (12), (19) and (20) for m = M until all the Mjrk p are expressed in terms of 001 M p . The substitution process are then repeated for m = M -2, M -3, …, 1, 0 where of equations, we will get the value of 001 M p and substituting this value into (24), all stationary probabilities mjrk p will be obtained.…”