chickadee » nanograd » clip-gradients-by-value!

clip-gradients-by-value! parameters clip-valueprocedure

Clamps each gradient element to the range [-clip-value, clip-value].

(backward! loss)
(clip-gradients-by-norm! (parameters model) 1.0)
(step! optimizer)