Applied AI·Production patterns and cost
you render tokens as they land, show which tool is running, and handle the stream that dies halfway through.
Streaming UX patterns
Draft summary, pending review
Product techniques on top of streaming: render tokens live, show tool-use progress, allow cancel mid-generation, handle a stream that dies halfway (retry or resume). Perceived speed lives here as much as in the model.