Applied AI·Local and self-hosted inference
you run a serious model on your own laptop, and the thing making that possible underneath is llama.cpp.
llama.cpp
Draft summary, pending review
The C/C++ inference engine that made serious local inference practical on ordinary machines, including Apple Silicon. Defines the GGUF format and GBNF grammars, and underpins much of the local ecosystem.