- transformer token pos config state weightsprocedure
Runs the model on token id token at position pos, updating state in place; the logits are left in (run-state-logits state). Returns state.
The steps of the forward pass are exported individually. Each one reads and writes the vectors of state; layer-idx selects the layer.