Markov chain
Random walk
Chapman–Kolmogorov equation
Stochastic matrix
Markov property
Statistics
Markov processes
Markov models