attention-rmsnorm | chickadee

attention-rmsnorm state weights layer-idx configprocedure: xb := RMS-normalized x, scaled by the attention norm weights.

chickadee » llama » attention-rmsnorm