Skill: Local Model Selection
by Hugging Face
Choose and run the right local model with llama.cpp and GGUF — quantisation, hardware fit, and local serving.
Running GGUF-quantised models locally with llama.cpp — on CPU, Apple Metal, CUDA or ROCm — including quant selection and OpenAI-compatible local serving.
1 skill tagged llama.cpp.
by Hugging Face
Choose and run the right local model with llama.cpp and GGUF — quantisation, hardware fit, and local serving.
Tags that appear alongside this one, ranked by how often.