Markov chain

A Markov chain is a sequence of random variables in which the
future variable is determined by the present variable but is independent
of the way in which the present state arose from its predecessors. In other
words, a Markov chain describes a chance process in which the future state
can be predicted from its present state as accurately as if its entire earlier
history was known. Markov chains are named after the Russian mathematician
Andrei Andrevich Markov (1856–1922) who first studied them in a literary
context, applying the idea to an analysis of vowels and consonants in a
text by Pushkin. But his work launched the theory of stochastic processes and has since been applied in quantum theory, particle physics,
and genetics.