chickadee » llama » backend-forward!

backend-forward! backend token posprocedure

Runs the model on token id token at position pos and returns the f32vector of logits, one per vocabulary entry. Positions are given in order, starting at 0.