Skip to content

LLM Gateway

One endpoint and one key in front of many models, with routing, failover and spend tracking.

11 apps tagged LLM Gateway.

Best LLM Gateway AI tools, ranked

Apps

All apps
Featured

One API and one bill for hundreds of language models, with automatic failover between providers.

Coding & DevelopmentFreemium

One API for agent harnesses — run Codex, Claude Code or Hermes behind your product with shared sessions, streaming, files and cost controls, and swap harness with a config change.

Coding & DevelopmentFreemium

Privacy-first AI gateway putting 600+ models from 90+ providers behind one OpenAI-compatible API, with no prompt or output logging.

Coding & DevelopmentPaid
New

Free, open-source model switcher that lets Claude Code, Codex, Gemini CLI and other coding agents run any provider's model through one local gateway.

Coding & DevelopmentFree

AI gateway and LLM router: one OpenAI-compatible API for 600+ models, with fallback, load-balancing, latency and auto-routing policies, spend limits and EU routing.

Coding & DevelopmentFreemium

Open-source AI gateway and LLM observability: one OpenAI-compatible endpoint for 100+ models, with fallbacks, caching, cost tracking and request tracing.

Coding & DevelopmentFreemium

App: LiteLLM

BerriAI

Open-source, self-hosted AI gateway and Python SDK: one OpenAI-compatible API for 100+ providers, with spend tracking, budgets and guardrails.

Coding & DevelopmentFreemium

App: Portkey

Portkey (Palo Alto Networks)

AI gateway and LLMOps platform: one API to 1,600+ models with fallbacks, caching, guardrails, cost tracking and prompt management.

Coding & DevelopmentFreemium

App: ChatLLM

Abacus.AI

Abacus.AI's multi-model assistant: one $10/month subscription across 100+ frontier models, plus an autonomous agent, live meeting transcription and media generation.

General PurposeSubscription

An open-source proxy that sits between your coding agent and the model, compressing tool schemas, file reads and stale history to cut token bills.

Coding & DevelopmentFreemium

A hosted LLM gateway from ngrok: one base URL and one key for public providers, your own keys and self-hosted models, with failover, scoped access and cost analytics.

Coding & DevelopmentPaid

Related tags

Tags that appear alongside this one, ranked by how often.

All tags