Applied AI·The API layer
the first token came back fast and then the words trickled out, which is a different number from the one you were tracking.
Inter-token latency
Draft summary, pending review
The gap between successive streamed tokens; the steady-state speed after TTFT. Together with TTFT it fully describes streaming performance.