jargon

Applied AI·The API layer

nobody is waiting for these ten thousand answers, so you submit them as one file overnight and pay half.

Batch API

Draft summary, pending review

An asynchronous endpoint: submit a file of requests, collect results within a service window (commonly 24 hours) at a large discount, typically 50 percent. The default choice for evals, backfills and any workload without a user waiting.

Commonly confused with