Runtime state for transformer computation including hidden states, attention caches, and output logits.