jargon

Applied AI·Local and self-hosted inference

you run a serious model on your own laptop, and the thing making that possible underneath is llama.cpp.

llama.cpp

Draft summary, pending review

The C/C++ inference engine that made serious local inference practical on ordinary machines, including Apple Silicon. Defines the GGUF format and GBNF grammars, and underpins much of the local ecosystem.