Skip to content

llama.cpp

Running GGUF-quantised models locally with llama.cpp — on CPU, Apple Metal, CUDA or ROCm — including quant selection and OpenAI-compatible local serving.

1 skill tagged llama.cpp.

Skills

All skills

Related tags

Tags that appear alongside this one, ranked by how often.

All tags