Markov basic theory

correction:
Definition of \mu_i = expected time of falling into trapped state starting from state i.

0:00 Markov chain overview
0:40 Probability flow conservation laws
2:54 Steady state calculations
5:14 Absorption rate
7:21 Mean recurrent time of S

statistics playlist:

MIT courses:
basic concept,
probability flow conservation laws,
steady-state calculations

Preidicity,
birth death process discrete

birth death process continuous,
absorption rate, Mean recurrent time