chickadee » nanograd-components » make-rmsnorm-layer

make-rmsnorm-layer normalized-shape #!key (eps 1e-06) (dtype 'f32) (name RMSNorm)procedure
make-layer-norm normalized-shape #!key (eps 1e-06) (dtype 'f32) (name LayerNorm)procedure

Normalization over the last axis. normalized-shape is the list (hidden-dim).