Comparison
llama.cppvsOllama
llama.cpp
you run a serious model on your own laptop, and the thing making that possible underneath is llama.cpp.
The C/C++ inference engine that made serious local inference practical on ordinary machines, including Apple Silicon. Defines the GGUF format and GBNF grammars, and underpins much of the local ecosystem.
Full entry →Ollama
you pull a model with one command and get a local HTTP API shaped like the hosted one, which is right for your scripts and not for a fleet.
The developer-friendly local runner: pulls models from a registry, manages them, and exposes a local HTTP API mirroring the hosted-API shape. Built on llama.cpp. The right tool for your scripts and experiments; capable single-machine serving, not a fleet-scale server.
Full entry →