Hopfield Network — Memory & Capacity

Store P random patterns in N-neuron Ising network. Retrieval overlap vs load α=P/N. Capacity ~0.138N.

Network Parameters

Load α=P/N:
Final overlap m:
Retrieval success:
Capacity limit:
Hopfield (1982):
W_ij = (1/N) Σ_μ ξ^μ_i ξ^μ_j
Update: s_i ← sign(Σ_j W_ij s_j)
Overlap m_μ = (1/N)⟨s·ξ^μ⟩

Critical load: α_c ≈ 0.138
Above capacity → spurious states appear.