chickadee » nanograd » make-linear-warmup-schedule

make-linear-warmup-schedule init-lr final-lr warmup-stepsprocedure

Rises linearly from init-lr to final-lr over warmup-steps steps, then stays at final-lr.