Loss Surface Racer

A field survey of optimisation landscapes

Plate
—
Model
—
Parameters
—
Samples
—

Choose a survey plate

    The map is a 2-D slice θ(t) + α·i(t) + β·j(t) through weight space, centred on you. The slice turns smoothly — along the shortest path, at most ω rad/s — so that it always contains the downhill direction, though never on a fixed axis. Reach the finish contour before the gradient-descent ghost.

    ↑↓ choose  ·  Enter survey

    Fig. — slice through θ ∈ ℝn, loss shaded on a log scale of excess over the minimum. you ghost −∇L in slice finish