- transformer token pos config state weightsprocedure
Run transformer forward pass for a single token.
- token
- Token ID to process
- pos
- Position in sequence
- config
- Model configuration
- state
- Runtime state (modified in place)
- weights
- Model parameters
Returns the updated state.