chickadee » llama » make-args

make-args checkpoint tokenizer temperature steps prompt seedprocedure

Returns the arguments of a generation run.

checkpoint
path of the model checkpoint
tokenizer
path of the tokenizer file
temperature
sampling temperature; 0.0 selects the most likely token
steps
number of tokens to generate; values below 1 or above the sequence length mean the sequence length
prompt
prompt text, possibly empty
seed
random seed, or #f to use the current time