// Inference & local runtime

vllm-project/vllm-metal

Community maintained hardware plugin for vLLM on Apple Silicon

Official · vLLM 项目Apache-2.0Active

01Recent releases

vllm-project/vllm-metal v0.32.0.dev20261022015004 Patchpre

Community maintained hardware plugin for vLLM on Apple Silicon
vllm-project/vllm-metal v0.32.0.dev20261021162405 Patchpre

Community maintained hardware plugin for vLLM on Apple Silicon
vllm-project/vllm-metal v0.32.0.dev20261021111544 Patchpre

Community maintained hardware plugin for vLLM on Apple Silicon
vllm-project/vllm-metal v0.32.0.dev20261021103316 Patchpre

Community maintained hardware plugin for vLLM on Apple Silicon
vllm-project/vllm-metal v0.32.0.dev20261021101232 Patchpre

Community maintained hardware plugin for vLLM on Apple Silicon

ggml-org/llama.cpp LLM inference in C/C++ Inference & local runtime · official★ 132k

vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs Inference & local runtime · official★ 94.9k

mudler/LocalAI LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. Inference & local runtime★ 49.8k

exo-explore/exo Run frontier AI locally. Inference & local runtime★ 48.0k

ray-project/ray Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. Inference & local runtime★ 44.1k