20 Unsloth alternatives
Unsloth: Open-source desktop app to run, serve and fine-tune text, image, video and audio models entirely on your own machine. 20 apps do similar work, most sharing Open Source, Local Models and Inference, ranked by how much they have in common with Unsloth.
-
Cactus Compute, Inc.
8-29 MB automation models that run on phones, wearables and microcontrollers — tool calling, structured extraction and embeddings, fully offline.
Also: Fine-tuning, Inference, Local Models, Open Source
-
Inference, fine-tuning, and GPU clusters for open models — the full stack for teams building on open weights.
Also: Fine-tuning, GPU, Inference
-
Open-source inference engine that runs LLMs, vision and speech models fully on-device — no API keys, no cloud calls, from Swift to Godot.
Also: Inference, Local Models, Open Source
-
Open-source local inference server that profiles your hardware, picks models that fit, and points your coding agent at them — free, private and offline.
Also: Inference, Local Models, Open Source
-
Menlo Research
An open-source, offline-first ChatGPT alternative that runs models on your own computer.
Also: Desktop App, Local Models, Open Source
-
An open-source desktop AI client that talks to every major provider and your local models from one window.
Also: Desktop App, Local Models, Open Source
-
Production inference for open and custom models — fast, autoscaling, and deployable into your own cloud.
-
Serverless GPUs from a Python decorator — deploy models and batch jobs with no containers or cluster to manage.
-
Inference on custom LPU hardware, built for latency — open models served at speeds general-purpose GPUs struggle to match.
-
Simulate how fast a local LLM runs on a given GPU or Mac before you buy the hardware.
-
A polished desktop app for discovering, running, and chatting with local language models — no terminal required.
Also: Desktop App, Local Models
-
EGOIST
A fast, local-first desktop AI chat client that works with GPT, Claude, Gemini, and local models, with markdown and LaTeX rendering, web search, image generation, and MCP tool support.
Also: Desktop App, Local Models
-
The open-source AI hub: over a million models, hundreds of thousands of datasets, and hosted demo Spaces.
Also: Inference, Open Source
-
Jun Kim
Menu-bar LLM inference server for Apple Silicon, with continuous batching and tiered KV caching that keeps local models fast enough for real coding work.
Also: Inference, Open Source
-
Continue
Open-source AI coding agent for VS Code, JetBrains and the terminal; acquired by Cursor in 2026 and no longer maintained.
Also: Local Models, Open Source
-
A self-hosted, feature-rich chat interface that puts a polished front end on Ollama and any OpenAI-compatible API.
Also: Local Models, Open Source
-
Osaurus, Inc.
Native macOS harness for AI agents — any model, persistent memory, sandboxed execution and cryptographic identity, fully offline and open source.
Also: Local Models, Open Source
-
Advait Paliwal
Open-source AI research agent with a CLI and a local science workbench for deep literature review, paper retrieval and replication planning.
Also: Local Models, Open Source
-
Agentic AI Foundation
Open-source AI agent from the Agentic AI Foundation — a native desktop app, CLI and API that runs tasks locally with 70+ MCP extensions.
Also: Desktop App, Open Source
-
pungme
An open-source Mac app that gives Claude Code a real browser, a live iOS Simulator and its own git worktree per chat.
Also: Desktop App, Open Source