VRAM and unified memory

GPU memory bounds which models you can run: weights, KV cache and overhead must all fit. Apple Silicon's unified memory lets the GPU use ordinary RAM, which is why a 16GB M1 runs models a 16GB gaming PC with an 8GB card cannot.