Additional Readings
https://www.math.fsu.edu/~cstover/teaching/sp18_mas3105/handouts/ch1/REFetc.pdf - An introduction to elementary row operations, row echelon form (ROF), and reduced row echelon form (RREF).
https://setosa.io/ev/markov-chains/ - An interesting visual introduction of Markov chains. Includes a manipulatable transition matrix with a dynamic diagram to show its effects in real time.
http://langvillea.people.cofc.edu/MCapps7.pdf - Introduces and explains five historic applications of Markov chains.
References
Barwe. “采样2 - 离散马尔可夫链的几个性质.” 阔落煮酒, 9 July 2019, chenyin.top/stat/20190416-ea6c.html.
Bertsekas, Dimitri P., and John N. Tsitsiklis. Introduction to Probability. Athena Scientific, 2008.
Bulla, Jan. “5 - Basic Structure of a Hidden Markov Model.” ResearchGate, Jan. 2006, www.researchgate.net/figure/Basic-structure-of-a-Hidden-Markov-Model_fig2_24115579.
“Chapter 11 Markov Chains.” Dartmouth, dartmouth.edu/~chance/teaching_aids/books_articles/probability_book/Chapter11.pdf. (Online PDF)
“Markov Chains.” Brilliant Math & Science Wiki, brilliant.org/wiki/markov-chains/.
Weissman, Alex. “Going Steady (State) with Markov Processes.” Bloomington Tutors Blog, bloomingtontutors.com/blog/going-steady-state-with-markov-processes.
WU, JUN. BEAUTY OF MATHEMATICS. CHAPMAN & HALL CRC, 2018.
