The Perron-Frobenius theorem guarantees a unique stationary distribution (eigenvector for λ=1) for any irreducible Markov chain. Watch power iteration converge to the stationary state.