Control theory
Dynamic programming
Stochastic control
Markov decision process
Markov chain
Stochastic matrix
Statistics
Markov processes
Markov models