Line 16: Line 16:
 
# [[Recurrent State and Transient State]]
 
# [[Recurrent State and Transient State]]
  
−
[[Theorem: Steady-State Vectors / Stationary Distribution]]
+
[[Markov Chain Theorems]]
  
 
[[Restrictions of Stationary Distribution]]
 
[[Restrictions of Stationary Distribution]]

Revision as of 02:44, 6 December 2020

Markov Chains

Yi Li and Nicholas Fang

Table of Contents

Introduction and Historic Background

Basics of Markov Chains

  1. Transition Diagrams
  2. Transition Probability Matrix
  3. n-th Term Transition
  4. Python Demonstration

Classification of States

  1. Communication and Reducibility
  2. Periodicity of Markov Chains
  3. Recurrent State and Transient State

Markov Chain Theorems

Restrictions of Stationary Distribution

Applications of Markov Chains

Markov Chain References and Additional Readings

Retrieved from "https://www.projectrhea.org/rhea/index.php?title=Walther_MA271_Fall2020_topic2&oldid=78386"
Shortcuts
Help Main Wiki Page Random Page Special Pages Log in
Search

Alumni Liaison

Basic linear algebra uncovers and clarifies very important geometry and algebra.

Dr. Paul Garrett