20 LiteLLM alternatives
LiteLLM: Open-source, self-hosted AI gateway and Python SDK: one OpenAI-compatible API for 100+ providers, with spend tracking, budgets and guardrails. 20 apps do similar work, most sharing Open Source, Self-Hosted and Python, ranked by how much they have in common with LiteLLM.
-
Portkey (Palo Alto Networks)
AI gateway and LLMOps platform: one API to 1,600+ models with fallbacks, caching, guardrails, cost tracking and prompt management.
Also: Cost Optimization, LLM Gateway, Open Source
-
An open-source proxy that sits between your coding agent and the model, compressing tool schemas, file reads and stale history to cut token bills.
Also: Cost Optimization, LLM Gateway, Open Source
-
Secure cloud sandboxes where AI agents can run untrusted code safely, starting in milliseconds.
Also: Open Source, Python, Self-Hosted
-
IBM (DataStax)
Open-source, MIT-licensed visual builder for AI agents, RAG apps and MCP servers, maintained by IBM's DataStax and extensible in Python.
Also: Open Source, Python, Self-Hosted
-
HKUDS
Open-source, self-hosted personal AI agent you run yourself — browser UI, terminal or your chat apps, with memory, MCP tools and scheduled automations.
Also: Open Source, Python, Self-Hosted
-
One API and one bill for hundreds of language models, with automatic failover between providers.
Also: Cost Optimization, LLM Gateway
-
One API for agent harnesses — run Codex, Claude Code or Hermes behind your product with shared sessions, streaming, files and cost controls, and swap harness with a config change.
Also: Cost Optimization, LLM Gateway
-
ngrok
A hosted LLM gateway from ngrok: one base URL and one key for public providers, your own keys and self-hosted models, with failover, scoped access and cost analytics.
Also: Cost Optimization, LLM Gateway
-
Free, open-source local MCP gateway: register each server once, share it with every AI client, and cut tool-definition tokens by up to 91%.
Also: Cost Optimization, Open Source
-
Abhishek Iyer
A local, keyboard-driven diff viewer built for the huge changes coding agents produce - and it remembers what you have already seen.
Also: Open Source, Python
-
The framework and observability platform most teams use to build, debug, and ship LLM agents.
Also: Open Source, Python
-
Vectify AI
A vectorless RAG engine that builds a tree index of long PDFs and lets an LLM reason its way to the right section, with page-level citations.
Also: Open Source, Python
-
Open-source LLM observability — trace, evaluate, and improve AI applications with production data.
Also: Open Source, Python
-
The multi-agent framework where agents have roles and collaborate as a crew — plus a platform to run them in production.
Also: Open Source, Python
-
All Hands AI
OpenHands — the leading open-source coding agent platform, self-hostable or run in the cloud.
Also: Open Source, Self-Hosted
-
Jun Kim
Menu-bar LLM inference server for Apple Silicon, with continuous batching and tiered KV caching that keeps local models fast enough for real coding work.
Also: Open Source, Self-Hosted
-
Roo Code
Self-hostable cloud coding agent from the Roo Code team — investigates repos, verifies its own work and opens pull requests, driven from Slack, Teams, Discord or Telegram rather than an IDE.
Also: Open Source, Self-Hosted
-
A self-hosted, feature-rich chat interface that puts a polished front end on Ollama and any OpenAI-compatible API.
Also: Open Source, Self-Hosted
-
OpenClaw Foundation
Open-source personal AI assistant that runs on your own machine and answers from WhatsApp, Telegram, Slack, iMessage and 25 other chat apps.
Also: Open Source, Self-Hosted
-
Cloudflare
Open-source AI workspace you deploy into your own Cloudflare account: agent chat wired to company context, sandboxed app building, and policy guardrails.
Also: Open Source, Self-Hosted