Applied AI·How models work
the big expensive model becomes the teacher, and what you actually ship is the small one that learned to imitate it.
Distillation
Draft summary, pending review
Training a smaller, cheaper model to imitate a larger one's outputs. The large model is the teacher, the small one the student. It is the standard route to cutting inference cost once a frontier model has proven a task is solvable.