Markov Chain

Random walk on Markov chain. Bar heights show empirical visit frequency vs. stationary distribution (dashed).