chickadee » llama » compute-attention

compute-attention state layer-idx pos configprocedure

Multi-head attention of q over the cached positions 0..pos; the result is stored in xb.