vllm-project/semantic-router

vllm-project/semantic-router is an official vLLM 项目 repository in our “Model gateways & routers” category, written mainly in Go and licensed under Apache-2.0. As of 2026-10-23 it has 6,247 stars and 1,067 forks, ranking #8 of 9 tracked Model gateways & routers repos and #733 of all 1046 repos we track. It was created on 2025-08-26 (about 1.1 years ago); the latest commit is from 2026-10-23, so it is actively updated. The latest release is v0.4.0 (2026-09-27), with 1 release in the last 30 days.

GitHub topics:ai-gatewayguardrailsinferencekubernetesllmllmroutermixture-of-modelspytorchsemantic-routertransformervllm

• 

  vllm-project/semantic-router v0.4.0 Minor

  Announcement

• vllm-project/vllm ★ 95.2k · inference, llm, pytorch, transformerA high-throughput and memory-efficient inference and serving engine for LLMs
• LMCache/LMCache ★ 12.2k · inference, llm, pytorch, vllmLMCache: Supercharge Your LLM with the Fastest KV Cache Layer
• xorbitsai/inference ★ 9,623 · inference, llm, pytorch, vllmSwap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one un…
• vllm-project/vllm-ascend ★ 3,000 · inference, llm, transformer, vllmCommunity maintained hardware plugin for vLLM on Huawei Ascend
• huggingface/transformers ★ 168k · llm, pytorch, transformerTransformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
• sgl-project/sglang ★ 37.6k · inference, llm, transformerSGLang is a high-performance serving framework for large language models and multimodal models.

• vllm ★ 95.2k · Inference & local runtime
• vllm-omni ★ 7,305 · Speech & audio
• aibrix ★ 5,159 · Inference & local runtime
• llm-compressor ★ 3,903 · Inference & local runtime
• vllm-ascend ★ 3,000 · Inference & local runtime
• production-stack ★ 2,689 · Inference & local runtime
• vllm-metal ★ 1,901 · Inference & local runtime

• ai-gateway →
• guardrails-ai/guardrails →
• inference →
• kubernetes →
• llm →
• PyTorch →