- make-mlp-mixer-block seq-len hidden-dim #!key (token-expansion 4) (channel-expansion 4) (use-rmsnorm #t) (dtype 'f32) nameprocedure
- make-token-mixing-mlp seq-len hidden-dim #!key (expansion-factor 4) (dtype 'f32) (name TokenMixing)procedure
- make-channel-mixing-mlp hidden-dim #!key (expansion-factor 4) (dtype 'f32) (name ChannelMixing)procedure
- make-mixer-mlp input-dim hidden-dim #!key (dtype 'f32) (name MixerMLP)procedure
Building blocks: one block, the two kinds of mixing MLP, and the underlying two-layer MLP with GELU.