Applied AI·Tokens
everything the model can ever emit is drawn from one fixed list of a few tens of thousands of entries.
Vocabulary
Draft summary, pending review
The fixed set of tokens a model knows, typically 32,000 to 250,000 entries. Every possible input is expressed as a sequence drawn from this set.