Applied AI·Production patterns and cost
the identical request comes in again and you return the stored answer, with no chance of it being a subtly different answer.
Exact-match caching
Draft summary, pending review
A plain cache on the normalised request. Only hits on identical inputs, but with zero wrong-answer risk; ideal for deterministic sub-steps (temperature 0 extraction, classification) inside larger pipelines.