20 Portkey alternatives
Portkey: AI gateway and LLMOps platform: one API to 1,600+ models with fallbacks, caching, guardrails, cost tracking and prompt management. 20 apps do similar work, most sharing Open Source, MCP and Cost Optimization, ranked by how much they have in common with Portkey.
-
BerriAI
Open-source, self-hosted AI gateway and Python SDK: one OpenAI-compatible API for 100+ providers, with spend tracking, budgets and guardrails.
Also: Cost Optimization, LLM Gateway, Open Source
-
An open-source proxy that sits between your coding agent and the model, compressing tool schemas, file reads and stale history to cut token bills.
Also: Cost Optimization, LLM Gateway, Open Source
-
Free, open-source local MCP gateway: register each server once, share it with every AI client, and cut tool-definition tokens by up to 91%.
Also: Cost Optimization, MCP, Open Source
-
One API and one bill for hundreds of language models, with automatic failover between providers.
Also: Cost Optimization, LLM Gateway
-
One API for agent harnesses — run Codex, Claude Code or Hermes behind your product with shared sessions, streaming, files and cost controls, and swap harness with a config change.
Also: Cost Optimization, LLM Gateway
-
ngrok
A hosted LLM gateway from ngrok: one base URL and one key for public providers, your own keys and self-hosted models, with failover, scoped access and cost analytics.
Also: Cost Optimization, LLM Gateway
-
The framework and observability platform most teams use to build, debug, and ship LLM agents.
Also: Observability, Open Source
-
Arize AI
AI engineering platform for tracing, evaluating and improving LLM apps and agents — with Phoenix, its open-source local-first counterpart, for teams that want to start without a vendor.
Also: Observability, Open Source
-
Open-source, OpenTelemetry-native observability platform for logs, metrics and traces — with first-class tracing for LLM calls and agent runs.
Also: Observability, Open Source
-
An OpenTelemetry-native control plane for AI agents that enforces policy mid-run instead of paging you after the incident, with cost attribution and EU AI Act evidence built in.
Also: Observability, Open Source
-
Sim, Inc.
Open-source AI workspace where teams build, deploy and monitor agents on one canvas — visually or in code, across 1,000+ integrations.
Also: Observability, Open Source
-
Open-source LLM observability — trace, evaluate, and improve AI applications with production data.
Also: Observability, Open Source
-
Agentic AI Foundation
Open-source AI agent from the Agentic AI Foundation — a native desktop app, CLI and API that runs tasks locally with 70+ MCP extensions.
Also: MCP, Open Source
-
Open-source testing and evals platform for MCP servers — trace tool calls, debug OAuth, and catch cross-client regressions in CI.
Also: MCP, Open Source
-
Vercel Labs
Vercel Labs' tiny open-source coding agent: a ~6MB Zig binary that cold-starts in microseconds and embeds anywhere.
Also: MCP, Open Source
-
Native, open-source Mac database client for 29 engines, with a Claude-powered SQL assistant and its own MCP server.
Also: MCP, Open Source
-
Vectify AI
A vectorless RAG engine that builds a tree index of long PDFs and lets an LLM reason its way to the right section, with page-level citations.
Also: MCP, Open Source
-
Different AI
Open-source desktop app and MCP for running AI agents on your own files, an open alternative to Claude Cowork.
Also: MCP, Open Source
-
Open-source newsletter platform that bills for emails sent, not dormant subscribers, with an MCP server so AI agents can run it.
Also: MCP, Open Source
-
Gabriele Lozupone
Free, open-source desktop app that edits photos from a text description by running Qwen-Image 2.1 on your own GPU. No cloud, no account.
Also: MCP, Open Source