Applied AI·Tokens
the same string cost a different number of tokens on the other provider, because each model family ships its own.
Tokeniser
Draft summary, pending review
The component that converts text into token IDs before the model sees it, and back into text after. Each model family has its own tokeniser, so the same string produces different token counts on different models.