Steady-State Vectors
A transition matrix is considered regular if it has all positive entries. This is reflected in our example, as the transition matrix has only positive entries, so it must be regular. Regular Markov chains will eventually approach a fixed vector state $ q $, which is also known as the steady-state vector of a Markov chain. A steady-state vector is a vector that does not change after multiplying it with the transition matrix, satisfying the equation
This can also be written as
Where $ I $ is the identity matrix. To demonstrate this with our weather problem,
