A Markov chain generates symbols. The entropy rate H = -Σ πᵢ Σⱼ Pᵢⱼ log₂ Pᵢⱼ measures bits per symbol. Adjust transition probabilities and watch how order vs randomness changes the information content.