// Model gateways & routers
vllm-project/semantic-router
An open, programmable decision layer for models and compute.
Official · vLLM 项目Apache-2.0Active
01Recent releases
-
vllm-project/semantic-router v0.4.0 Minor
Announcement
02Same category
All repos →
BerriAI/litellm The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock,… Model gateways & routers★ 61.8k 
router-for-me/CLIProxyAPI Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build, Muse Code, Devin as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini Series,… Model gateways & routers★ 55.9k 
QuantumNous/new-api A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centr… Model gateways & routers★ 50.4k 
songquanpeng/one-api LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LL… Model gateways & routers★ 37.2k 
Portkey-AI/gateway A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. Model gateways & routers★ 13.2k