chickadee » nanograd » set-eval-mode!

set-eval-mode! layerprocedure

Shorthand for (set-training-mode! layer #f). Sets the layer to evaluation mode.

Training vs Evaluation Mode:

Training Mode ((set-training-mode! layer #t)):

  • Batch normalization uses batch statistics (mean and variance computed from current batch)
  • Dropout is active (if implemented)
  • Stochastic behavior enabled
  • Running statistics updated

Evaluation Mode ((set-eval-mode! layer)):

  • Batch normalization uses running statistics (accumulated during training)
  • Dropout is disabled
  • Deterministic behavior
  • Running statistics frozen