Skip to content
English

Switch theme

// Official vendor repos

vLLM 项目

8 tracked official repos · 39 releases in the last 30 days.

01Latest releases

02All repos

RepoCategory★LatestLicence
vllmA high-throughput and memory-efficient inference and serving engine for LLMsInference & local runtime94.9kv0.32.02026-10-18Apache-2.0
vllm-omniA framework for efficient model inference with omni-modality modelsSpeech & audio7,293v0.32.0rc12026-10-20Apache-2.0
semantic-routerAn open, programmable decision layer for models and compute.Model gateways & routers6,243v0.4.02026-09-27Apache-2.0
aibrixCost-efficient and pluggable Infrastructure components for GenAI inferenceInference & local runtime5,157v0.8.02026-10-13Apache-2.0
llm-compressorState-of-the-art LLM compression, built for production inference with vLLMInference & local runtime3,8970.9.0.52026-10-10Apache-2.0
vllm-ascendCommunity maintained hardware plugin for vLLM on Huawei AscendInference & local runtime2,996v0.30.0rc12026-10-14Apache-2.0
production-stackvLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimizationInference & local runtime2,682vllm-stack-0.1.132026-09-30Apache-2.0
vllm-metalCommunity maintained hardware plugin for vLLM on Apple SiliconInference & local runtime1,898v0.32.0.dev202610220150042026-10-22Apache-2.0

Data updated: GitHub OSS radar(UTC+8)