Comparison
InputvsOutput tokens
Input
Input tokens are everything you send.
Output tokens
Output tokens are what the model generates.
The difference
Input tokens are everything you send; output tokens are what the model generates. Output tokens typically cost several times more and dominate latency, because they are produced one at a time.
Entry: Input vs output tokens →