// Model gateways, routing & usage
Switch models, control cost
One endpoint for many models, with routing, rate limits, billing and usage tracking.
35 tools27 open sourcechecked 2026-10-22Compare side by side →
How to choose · start with these three
- · Self-host: LiteLLM (open source); hosted: OpenRouter
- · Use authorised providers only; unauthorised resellers are excluded
35 / 35 items
litellm v1.104.2 ★ 62k The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] Open source SDKAPI OpenRouter Unified API gateway to hundreds of models with pay-as-you-go billing. Closed / commercial Freemium WebAPI claude-code-router v3.1.3 ★ 38k One local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay fully in control. Open source CLI Google AI Studio Google's developer console for prototyping with Gemini and getting API keys. Closed / commercial Freemium WebAPI fal Developer inference platform for image, video and audio generation models. Closed / commercial Paid APIWeb experiential ★ 9.9k Open-source zero-markup gateway for BYOK, self-hosted and 1000+ marketplace models. Open source API headroom ★ 77k Compresses tool outputs and RAG chunks before they hit the LLM. Open source CLIproxyMCP free-claude-code ★ 61k Routes free model quotas into Claude Code, Codex and other harnesses. Open source proxy axonhub v1.0.0-beta11 ★ 5.4k Open-source AI gateway — any SDK to 100+ LLMs with failover and load balancing. Open source server rtk v1.0.1 ★ 84k CLI proxy that cuts LLM token use 60–90% on common dev commands. Open source CLI OmniRoute ★ 77k Free MIT AI gateway to 290+ providers and 500+ models. Open source API freellmapi v0.16.7 ★ 39k OpenAI-compatible proxy stacking free tiers of 16 LLM providers. Open source API context-mode ★ 32k Context-window optimization that sandboxes tool output. Open source proxy tyk ★ 11k Open-source API and AI gateway supporting REST, GraphQL, gRPC and MCP. Open source server llm-gateway ★ 7.6k Open-source LLM gateway. Open source server CLIProxyAPI v8.0.23 ★ 56k Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build, Muse Code, Devin as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini Series, GPT Series, Grok Series, Claude model through API Open source API new-api v1.0.0-rc.46 ★ 50k A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management. Open source API kong 3.9.3 ★ 44k 🦍 The API and AI Gateway Open source API one-api v0.6.10 ★ 37k LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI. Open source API envoy v1.39.3 ★ 29k Cloud-native high-performance edge/middle/service proxy Open source API apisix 3.19.0 ★ 17k The Cloud-Native API Gateway and AI Gateway Open source API Portkey-AI/gateway v1.15.2 ★ 13k A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. Open source API higress v2.2.5 ★ 9.5k 🤖 AI Gateway | AI Native API Gateway Open source API bifrost v2.2.6 ★ 9.0k Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS. Open source API plano 0.4.37 ★ 7.1k Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic. Open source API kgateway v2.3.10 ★ 5.7k The Cloud-Native API Gateway and AI Gateway Open source API agentgateway v1.6.0 ★ 5.2k Next Generation Agentic Proxy for AI Agents and MCP servers Open source API any-llm 1.33.0 ★ 2.2k Communicate with an LLM provider using a single interface Open source SDK agent-router v1.2.0 ★ 2.2k Manages Unified Access to Generative AI Services built on Envoy Gateway Open source API ai-gateway v0.2.0-beta.30 ★ 636 The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced. Open source API Alibaba Cloud Model Studio (Bailian) Closed / commercial ccusage Open spec Cloudflare AI Gateway Closed / commercial TrueFoundry Closed / commercial Volcengine Ark / AI Gateway Closed / commercial
About this data
- Default order is “recommended”: editorial picks first, then by popularity; general-purpose developer software and archived projects are listed last.
- Data checked 2026-10-22. Official links only. JSON API