Skip to content
English

Switch theme

// Open-model VRAM table · family

Kimi: local deployment & VRAM

14 open-weight models from Moonshot AI (17 official repos incl. quantised builds). At 4-bit they range from 11.4 GB (Moonlight-16B-A3B-Instruct) to 1.87 TB (Kimi-K3).

official orgs: moonshotailatest 2026-06-13memory = estimate

01Text LLM (6)

ModelParamsContextBF164-bitSmallest GPU (4-bit)Mac (4-bit)LicenceReleased
Kimi-K2-Thinking1T / 32B 256K 2.20 TB668 GB 8 × H200 (1,128GB)— Commercial with conditions2025-11-04
Kimi-Linear-48B-A3B-Instruct49.1B / 3B — 109 GB33.3 GB 2 × RTX 5090 (64GB)Mac 64GB Commercial OK2025-10-30
Kimi-K2-Instruct-09051T / 32B 256K 2.20 TB668 GB 8 × H200 (1,128GB)— Commercial with conditions2025-09-03
Kimi-K2-Instruct1T / 32B 128K 2.20 TB668 GB 8 × H200 (1,128GB)— Commercial with conditions2025-07-11
Kimi-Dev-72B ↗72.7B 128K 163 GB51.7 GB 2 × RTX 5090 (64GB)Mac 128GB Commercial OK2025-06-16
Moonlight-16B-A3B-Instruct16B / 3B 8K 35.9 GB11.4 GB 16GB GPUMac 24GB Commercial OK2025-02-22

02Vision-language (7)

ModelParamsContextBF164-bitSmallest GPU (4-bit)Mac (4-bit)LicenceReleased
Kimi-K32.8T / 104B 1M 6.16 TB1.87 TB 8 × B300 (2,304GB)— Custom licence – read it2026-06-13
Kimi-K2.7-Code1T / 32B 256K 2.20 TB668 GB 8 × H200 (1,128GB)— Commercial with conditions2026-06-11
Kimi-K2.61T / 32B 256K 2.20 TB668 GB 8 × H200 (1,128GB)— Commercial with conditions2026-04-14
Kimi-K2.51T / 32B 256K 2.20 TB668 GB 8 × H200 (1,128GB)— Commercial with conditions2026-01-01
Kimi-VL-A3B-Thinking-250616.4B / 3B 128K 36.8 GB11.7 GB 16GB GPUMac 24GB Commercial OK2025-06-21
Kimi-VL-A3B-Instruct16.4B / 3B 128K 36.8 GB11.7 GB 16GB GPUMac 24GB Commercial OK2025-04-09
Kimi-VL-A3B-Thinking16.4B / 3B 128K 36.8 GB11.7 GB 16GB GPUMac 24GB Commercial OK2025-04-09

03Text-to-speech / audio (1)

ModelParamsBF164-bitSmallest GPU (4-bit)Mac (4-bit)LicenceReleased
Kimi-Audio-7B-Instruct9.77B 22.0 GB7.0 GB 8GB GPUMac 16GB Commercial OK2025-04-25

04Other families

Qwen · IBM Granite · NVIDIA Nemotron · Gemma · Mistral / Magistral / Devstral · GLM / CogVideoX (Z.ai) · DeepSeek · Ai2 OLMo / Molmo · Ant Ling / Ring / Ming · Liquid LFM · MiniCPM / VoxCPM · Tencent Hunyuan / Hy · Phi · Llama · Meituan LongCat · Jina embeddings & rerankers · Wan · Cohere Command / Aya · Xiaomi MiMo · FLUX · Microsoft VibeVoice / Fara / Harrier · InternLM / Intern-S · StepFun Step · MiniMax · Baidu ERNIE · NVIDIA Parakeet / Canary speech · Stable Diffusion / Stable Audio · Yi (01.AI) · ByteDance Seed · SmolLM / SmolVLM · BGE embeddings & rerankers · LTX Video · FunAudioLLM speech · gpt-oss · poolside Laguna · Whisper · Baichuan · Thinking Machines Inkling · xAI Grok · rednote dots

Totals include 10% + 0.5GB overhead and one 8K-token KV cache for text models. Estimates only. Method →

Data updated: Self-host open models(UTC+8)