Iteration t
Current loss
Best iterate loss
\(\|\nabla f(\mathbf x_t)\|\)

Red cross: current xₜ
Blue: actual last step
Gray: previous iterates
Dashed gray: −∇f direction