Skip to content
English

Switch theme

// Open-model VRAM table · family

Yi (01.AI): local deployment & VRAM

9 open-weight models from 01.AI (13 official repos incl. quantised builds). At 4-bit they range from 3.1 GB (Yi-Coder-1.5B-Chat) to 25.4 GB (Yi-1.5-34B-Chat-16K).

official orgs: 01-ailatest 2024-08-21memory = estimate

01Text LLM (9)

ModelParamsContextBF164-bitSmallest GPU (4-bit)Mac (4-bit)LicenceReleased
Yi-Coder-1.5B-Chat ↗1.48B 128K 5.4 GB3.1 GB 8GB GPUMac 16GB Commercial OK2024-08-21
Yi-Coder-9B-Chat8.83B 128K 20.7 GB7.2 GB 8GB GPUMac 16GB Commercial OK2024-08-21
Yi-1.5-9B-Chat-16K8.83B 16K 20.7 GB7.2 GB 8GB GPUMac 16GB Commercial OK2024-05-15
Yi-1.5-34B-Chat-16K34.4B 16K 78.2 GB25.4 GB RTX 5090 32GBMac 64GB Commercial OK2024-05-15
Yi-1.5-9B-32K8.83B 32K 20.7 GB7.2 GB 8GB GPUMac 16GB Commercial OK2024-05-15
Yi-1.5-34B-32K34.4B 32K 78.2 GB25.4 GB RTX 5090 32GBMac 64GB Commercial OK2024-05-15
Yi-1.5-6B6.06B 4K 14.4 GB5.1 GB 8GB GPUMac 16GB Commercial OK2024-05-11
Yi-1.5-9B-Chat8.83B 4K 20.7 GB7.2 GB 8GB GPUMac 16GB Commercial OK2024-05-10
Yi-1.5-34B-Chat34.4B 4K 78.2 GB25.4 GB RTX 5090 32GBMac 64GB Commercial OK2024-05-10

02Other families

Qwen · IBM Granite · NVIDIA Nemotron · Gemma · Mistral / Magistral / Devstral · GLM / CogVideoX (Z.ai) · DeepSeek · Ai2 OLMo / Molmo · Ant Ling / Ring / Ming · Liquid LFM · MiniCPM / VoxCPM · Tencent Hunyuan / Hy · Phi · Llama · Meituan LongCat · Jina embeddings & rerankers · Wan · Kimi · Cohere Command / Aya · Xiaomi MiMo · FLUX · Microsoft VibeVoice / Fara / Harrier · InternLM / Intern-S · StepFun Step · MiniMax · Baidu ERNIE · NVIDIA Parakeet / Canary speech · Stable Diffusion / Stable Audio · ByteDance Seed · SmolLM / SmolVLM · BGE embeddings & rerankers · LTX Video · FunAudioLLM speech · gpt-oss · poolside Laguna · Whisper · Baichuan · Thinking Machines Inkling · xAI Grok · rednote dots

Totals include 10% + 0.5GB overhead and one 8K-token KV cache for text models. Estimates only. Method →

Data updated: Self-host open models(UTC+8)