CMA-ES
Gradient descent
Newton
BFGS
SGD
Adam
AdamW
Rotated quadratic
Rastrigin
Loss scale
Linear
Log
Step size η
0.25/L · small
1/L · standard
1.9/L · large
Start
(2.5, 2.5)
(2.6, 2.3)
Play
Step
Initial state
Gradient noise
Off
Moderate (σ = 10)
Strong (σ = 30)
Extreme (σ = 100)
Batch b
1
8
Seed
3
7
SGD step
1/L
2/L
4/L
Schedule
Constant
Explore → settle
Decay λ
0.1
0
1