20 llmspeed alternatives
llmspeed: Simulate how fast a local LLM runs on a given GPU or Mac before you buy the hardware. 20 apps do similar work, most sharing Inference, GPU and Hardware, ranked by how much they have in common with llmspeed.
-
Unsloth AI
Open-source desktop app to run, serve and fine-tune text, image, video and audio models entirely on your own machine.
-
Production inference for open and custom models — fast, autoscaling, and deployable into your own cloud.
-
Serverless GPUs from a Python decorator — deploy models and batch jobs with no containers or cluster to manage.
-
Inference, fine-tuning, and GPU clusters for open models — the full stack for teams building on open weights.
-
Inference on custom LPU hardware, built for latency — open models served at speeds general-purpose GPUs struggle to match.
-
Vibe Inc.
Wearable AI recorder that turns meetings, calls and ideas into transcripts, summaries and action items, online or offline.
Also: Hardware
-
The open-source AI hub: over a million models, hundreds of thousands of datasets, and hosted demo Spaces.
Also: Inference
-
One API and one bill for hundreds of language models, with automatic failover between providers.
Also: Inference
-
Open-source inference engine that runs LLMs, vision and speech models fully on-device — no API keys, no cloud calls, from Swift to Godot.
Also: Inference
-
Jun Kim
Menu-bar LLM inference server for Apple Silicon, with continuous batching and tiered KV caching that keeps local models fast enough for real coding work.
Also: Inference
-
Privacy-first AI gateway putting 600+ models from 90+ providers behind one OpenAI-compatible API, with no prompt or output logging.
Also: Inference
-
Cactus Compute, Inc.
8-29 MB automation models that run on phones, wearables and microcontrollers — tool calling, structured extraction and embeddings, fully offline.
Also: Inference
-
Low-latency speech APIs from the team behind the open-source Dia model — text-to-speech and transcription priced well below the incumbents.
Also: Inference
-
Open-source local inference server that profiles your hardware, picks models that fit, and points your coding agent at them — free, private and offline.
Also: Inference
-
ngrok
A hosted LLM gateway from ngrok: one base URL and one key for public providers, your own keys and self-hosted models, with failover, scoped access and cost analytics.
Also: Inference
-
A generative media platform tuned for speed — image, video, and audio models served with very low latency.
Also: Inference
-
Run thousands of open models with one API call, and deploy your own without touching Kubernetes.
Also: Inference
-
Agentic data platform that turns business questions into defensible, auditable narratives — with sources, assumptions and lineage attached.
Also in Data & Analytics
-
Warehouse-native product analytics that joins AI agent traces to user behaviour, so you can see which tool calls actually convert.
Also in Data & Analytics
-
Turn any website into clean markdown or structured JSON — crawling, JavaScript rendering, and extraction in one API.
Also in Data & Analytics