It is well known that any irreducible and aperiodic Markov chain has
exactly one stationary distribution, and for any arbitrary initial distribution, the sequence
of distributions at time n converges to the stationary ...