- make-am-rmsnorm dim #!key (eps 1e-06) (dtype 'f32) (name AM-RMSNorm)procedure
- make-am-layernorm dim #!key (eps 1e-06) (dtype 'f32) (name AM-LayerNorm)procedure
- make-am-batch-norm-nhwc channels #!key (eps 1e-05) (dtype 'f32) (name AM-BN)procedure
Normalization layers. The batch normalization works on NHWC input and always uses the statistics of the current batch.