- make-run-state x xb q k v att key-cache value-cache xb2 hb hb2 logitsprocedure
Returns the activations of the forward pass, all f32vectors: x, xb, xb2, q, k and v of length dim; att of length n-heads * seq-len; key-cache and value-cache of length n-layers * seq-len * dim; hb and hb2 of length hidden-dim; logits of length vocab-size.