Neural Network Loss Landscape

A synthetic 2D loss surface with saddle points, local minima, and a global minimum. Watch Gradient Descent, SGD+Momentum, and Adam navigate the landscape simultaneously. Drag to rotate the 3D view.

GD (vanilla) SGD+Momentum Adam Global minimum
Drag canvas to rotate 3D view