Energy-Based Model

EBMs assign a scalar energy E(x) to each configuration. Low energy = high probability (p(x) ∝ exp(−E(x)/T)). Training pulls down energy on data, pushes up energy on model samples via contrastive divergence.

0.80
0.08
3
8
Left: energy landscape with MCMC chains · Right: sample histogram · Click to add data point