Discrete Stochastic Processes: Markov Chains
摘要
Markov chains, stochastic processes with discrete states and discrete time, are introduced. Various properties of Markov chains are illustrated and the role of barriers is discussed, including physical examples. Continuous-time processes are then introduced through the master equation.