Restrictions of Stationary Distribution - Rhea

=Restrictions of Stationary Distribution

In the last section, it is emphasized that steady-state vectors can be derived only with regular matrices. What if these vectors are not regular?

Consider a periodic Markov chain:

We can also write that in matrix form:

Going back to the Python program from before, when the initial state is $ [1, 0, 0] $,

Back to Markov Chains