chickadee » nanograd » set-training-mode!

set-training-mode! layer training?procedure

Puts the layer, and every layer inside a container, in training mode (training? is #t) or evaluation mode (#f). In training mode batch normalization uses batch statistics and updates its running statistics; in evaluation mode it uses the running statistics and leaves them unchanged.