Applied AI·Tokens
everything you send and everything it says has to fit one budget, and the retrieved documents are what usually blow it.
Context window
Draft summary, pending review
The maximum number of tokens the model can consider at once: system prompt, conversation history, retrieved documents and the output all share it. Current frontier models offer hundreds of thousands of tokens; small local models often 8K to 128K.