chickadee
»
llama
»
rmsnorm
Identifier search
rmsnorm
out
x
weight
procedure
out
:=
weight
*
x
/ sqrt(mean(
x
^2) + 1e-5), element-wise. Returns
out
.