Channel Capacity

Channel type

BSC crossover prob ε = 0.10

Input distribution p(0) = 0.50

Formulas:
BSC: C = 1 - H(ε)
BEC: C = 1 - ε
AWGN: C = ½log₂(1+SNR)

Channel diagram with transition probabilities and input/output distributions.

Capacity vs channel parameter. Dot = current setting. I(X;Y) vs p(0) for fixed parameter.

Water-filling: parallel AWGN channels. Power allocated inversely to noise level.