Discrete State Markov Processes

The probabilistic processes discussed thus far in this book for generating random variables (e.g., binomial or Poisson processes) are based on trials that are independent of one another. In other words, if multiple random variables were to be generated, the generation of each variable is an independent and identical process.