chickadee » llama » apply-swiglu

apply-swiglu state configprocedure

Apply SwiGLU activation: SiLU(W1(x)) * W3(x).