Applied AI·Production patterns and cost
you send the easy requests to the small cheap model and only the hard ones to the expensive one.
Model routing
Draft summary, pending review
Sending each request to the cheapest model adequate for it: simple queries to a small model, hard ones to a frontier model, based on rules or a lightweight classifier. Routine 60-to-90 percent cost reductions when the traffic mix is genuinely varied.