Applied AI·How models work
the answer arrives one word at a time, and a reply twice as long takes twice as long to finish.
Autoregressive
Draft summary, pending review
Generating output one token at a time, feeding each generated token back in as input for the next step. This is why output streams word by word and why generation cost scales with output length.