Markov Chains

Learning tasks

A) Markov Chain
1) Reading Transition Diagrams	Ex 1 Ex 2 Ex 3 Ex 4 Ex 5
B) Matrix Representation
2) Defining and Validating State Vectors	Ex 6 Ex 7 Ex 8 Ex 9
3) Building and Interpreting Transition Matrices	Ex 10 Ex 11 Ex 12 Ex 13 Ex 14 Ex 15
C) State Vectors and Future Probabilities
4) Calculating and Predicting States after One step	Ex 16 Ex 17 Ex 18
5) Calculating and Predicting States after Two Steps	Ex 19 Ex 20 Ex 21
D) Steady State
6) Finding Steady State	Ex 22 Ex 23 Ex 24

Lesson Summary
Text book

Exercises Correction
A) Markov Chain
    1) Reading Transition Diagrams Ex 1 Ex 2 Ex 3 Ex 4 Ex 5
B) Matrix Representation
    2) Defining and Validating State Vectors Ex 6 Ex 7 Ex 8 Ex 9
    3) Building and Interpreting Transition Matrices Ex 10 Ex 11 Ex 12 Ex 13 Ex 14 Ex 15
C) State Vectors and Future Probabilities
    4) Calculating and Predicting States after One step Ex 16 Ex 17 Ex 18
    5) Calculating and Predicting States after Two Steps Ex 19 Ex 20 Ex 21
D) Steady State
    6) Finding Steady State Ex 22 Ex 23 Ex 24