// Switch models, control cost
bifrostv2.2.6
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
Open source Maintained For agents
IN ONE PARAGRAPH
bifrost is fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
Good for: Developers who want their agent (Claude Code, Codex, Cursor…) to switch models, control cost.
01How to start
- 1Read the official README for requirements and permissions.
- 2Install it from the official package registry:
npm install @maximhq/bifrost - 3Tell your agent the command exists (e.g. in AGENTS.md / CLAUDE.md) so it knows when to call it.
02Alternatives & comparison
Compare side by side → Portkey-AI/gateway A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. ★ 13k plano Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic. ★ 7.1k litellm The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] ★ 62k ai-gateway The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced. ★ 636 agentgateway Next Generation Agentic Proxy for AI Agents and MCP servers ★ 5.2k
03Related
- ›Ollama 文档 · OllamaEnglish
- ›handy-ollama 动手学 Ollama · DatawhaleChinese
- ›vLLM 文档 · vLLMEnglish
- ›SGLang 文档 · SGLangEnglish
- ›llama.cpp · ggml-orgEnglish
- All tutorials →