Open-source desktop app to run, serve and fine-tune text, image, video and audio models entirely on your own machine.
Coding & DevelopmentFree
Summary
Simulate how fast a local LLM runs on a given GPU or Mac before you buy the hardware.
Screenshots
Description
llmspeed lets you feel the speed of a local language model before spending money on hardware. Pick a device and a model and it simulates the output in real time, using tokens per second and time-to-first-token figures drawn from verified benchmarks.
The hardware list covers NVIDIA RTX and datacenter GPUs, AMD Radeon and Ryzen AI Max systems, Intel Arc, Apple Silicon Macs, DGX Spark and CPU-only setups. The model list includes current open-weight families such as Qwen, Gemma, GLM, DeepSeek, GPT-OSS and Llama. Estimates assume a short prompt on a single device, and measured numbers come from community benchmarks.
It is free to use and helpful for anyone choosing a GPU, a Mac or a mini PC for running models locally.
Reviews
No reviews yet — sign in to write the first one
Similar App Suggestions
Production inference for open and custom models — fast, autoscaling, and deployable into your own cloud.
Coding & DevelopmentFreemium
Serverless GPUs from a Python decorator — deploy models and batch jobs with no containers or cluster to manage.
Coding & DevelopmentFreemium
Inference, fine-tuning, and GPU clusters for open models — the full stack for teams building on open weights.
Coding & DevelopmentFreemium
Inference on custom LPU hardware, built for latency — open models served at speeds general-purpose GPUs struggle to match.
Coding & DevelopmentFreemium