| Line 3: | Line 3: | ||
=Transition Diagrams= | =Transition Diagrams= | ||
| + | A Markov chain is a structure that determines the probability of future states using the current state. The specific probabilities calculated by this structure are called transition probabilities, and these probabilities make up a transition matrix, which is a square matrix that represents every possibility in the system. | ||
| + | ==Example Problem (Used throughout this paper)== | ||
| + | Every day, the weather is either rainy, sunny, or cloudy. If it is rainy today, then for tomorrow’s weather, there is a 40% chance of it being rainy again, a 20% chance of it being sunny, and a 40% chance of it being cloudy. If it is sunny today, then for tomorrow’s weather, there is a 70% chance of it being sunny again, a 10% chance of it being rainy, and a 20% chance of it being cloudy. If it is cloudy today, then for tomorrow’s weather, there is an 60% chance of it being cloudy again, a 30% chance of it being rainy, and a 10% chance of it being sunny. Find the transition matrix of this system. | ||
| − | + | In this problem, the three possible states are rainy, sunny, and cloudy days. The situation in the example can be modeled like so: | |
| + | [[File:Examplediagram.jpg|thumbnail|center]] | ||
| − | [[ Walther MA271 Fall2020 topic2|Back to | + | [[ Walther MA271 Fall2020 topic2|Back to Markov Chains]] |
Revision as of 22:17, 5 December 2020
Transition Diagrams
A Markov chain is a structure that determines the probability of future states using the current state. The specific probabilities calculated by this structure are called transition probabilities, and these probabilities make up a transition matrix, which is a square matrix that represents every possibility in the system.
Example Problem (Used throughout this paper)
Every day, the weather is either rainy, sunny, or cloudy. If it is rainy today, then for tomorrow’s weather, there is a 40% chance of it being rainy again, a 20% chance of it being sunny, and a 40% chance of it being cloudy. If it is sunny today, then for tomorrow’s weather, there is a 70% chance of it being sunny again, a 10% chance of it being rainy, and a 20% chance of it being cloudy. If it is cloudy today, then for tomorrow’s weather, there is an 60% chance of it being cloudy again, a 30% chance of it being rainy, and a 10% chance of it being sunny. Find the transition matrix of this system.
In this problem, the three possible states are rainy, sunny, and cloudy days. The situation in the example can be modeled like so:
