Line 15: Line 15:
 
# [[Periodicity of Markov Chains]]
 
# [[Periodicity of Markov Chains]]
 
# [[Recurrent State and Transient State]]
 
# [[Recurrent State and Transient State]]
 +
 +
[[Markov Chain Theorems]]
  
 
[[Markov Chain References and Additional Readings]]
 
[[Markov Chain References and Additional Readings]]

Revision as of 00:50, 6 December 2020

Markov Chains

Yi Li and Nicholas Fang

Table of Contents

Introduction and Historic Background

Basics of Markov Chains

  1. Transition Diagrams
  2. Transition Probability Matrix
  3. n-th Term Transition
  4. Python Demonstration

Classification of States

  1. Communication and Reducibility
  2. Periodicity of Markov Chains
  3. Recurrent State and Transient State

Markov Chain Theorems

Markov Chain References and Additional Readings

Alumni Liaison

Questions/answers with a recent ECE grad

Ryne Rayburn