Line 13: Line 13:
 
===Classification of States===
 
===Classification of States===
 
# [[Communication and Reducibility]]
 
# [[Communication and Reducibility]]
# [[Periodicity]]
+
# [[Periodicity of Markov Chains]]
 
# [[Recurrent State and Transient State]]
 
# [[Recurrent State and Transient State]]
  

Revision as of 00:23, 6 December 2020

Markov Chains

Yi Li and Nicholas Fang

Table of Contents

Introduction and Historic Background

Basics of a Markov Chain

  1. Transition Diagrams
  2. Transition Probability Matrix
  3. n-th Term Transition
  4. Python Demonstration

Classification of States

  1. Communication and Reducibility
  2. Periodicity of Markov Chains
  3. Recurrent State and Transient State

Alumni Liaison

Correspondence Chess Grandmaster and Purdue Alumni

Prof. Dan Fleetwood