chickadee » nanograd » learning-rate-at-step

Same as (schedule step).

(define schedule (make-cosine-schedule 1e-3 1e-5 10000 warmup-steps: 500))
(set-learning-rate! optimizer (schedule step))