Markov chain
Random walk
Stochastic matrix
Markov property
Semi-Markov process
Hidden Markov model
Statistics
Markov models
Markov processes