Skip to content
English

Switch theme

// Open-model VRAM table · family

Llama: local deployment & VRAM

16 open-weight models from Meta (34 official repos incl. quantised builds). At 4-bit they range from 1.6 GB (Llama-3.2-1B-Instruct) to 275 GB (Llama-3.1-405B).

official orgs: meta-llamalatest 2025-04-28memory = estimate

01Text LLM (6)

ModelParamsContextBF164-bitSmallest GPU (4-bit)Mac (4-bit)LicenceReleased
Llama-3.3-70B-Instruct70.6B 128K 158 GB50.2 GB 2 × RTX 5090 (64GB)Mac 128GB Commercial with conditions2024-11-26
Llama-3.2-1B-Instruct1.24B 128K 3.5 GB1.6 GB 8GB GPUMac 16GB Commercial with conditions2024-09-18
Llama-3.2-3B-Instruct3.21B 128K 8.5 GB3.6 GB 8GB GPUMac 16GB Commercial with conditions2024-09-18
Llama-3.1-8B-Instruct8.03B 128K 19.2 GB6.9 GB 8GB GPUMac 16GB Commercial with conditions2024-07-18
Llama-3.1-70B-Instruct70.6B 128K 158 GB50.2 GB 2 × RTX 5090 (64GB)Mac 128GB Commercial with conditions2024-07-16
Llama-3.1-405B405.9B 128K 898 GB275 GB 4 × RTX PRO 6000 (384GB)Mac 512GB Commercial with conditions2024-07-16

02Vision-language (3)

ModelParamsContextBF164-bitSmallest GPU (4-bit)Mac (4-bit)LicenceReleased
Llama-4-Scout-17B-16E-Instruct108.6B — 240 GB73.0 GB RTX PRO 6000 96GBMac 128GB Commercial with conditions2025-04-02
Llama-4-Maverick-17B-128E-Instruct401.6B — 884 GB268 GB 4 × RTX PRO 6000 (384GB)Mac 512GB Commercial with conditions2025-04-01
Llama-3.2-11B-Vision-Instruct10.7B — 24.0 GB7.6 GB 12GB GPUMac 16GB Commercial with conditions2024-09-18

03Safety / guard (7)

ModelParamsContextBF164-bitSmallest GPU (4-bit)Mac (4-bit)LicenceReleased
Llama-Prompt-Guard-2-22M71M — 0.7 GB0.5 GB 8GB GPUMac 16GB Commercial with conditions2025-04-28
Llama-Prompt-Guard-2-86M279M — 1.1 GB0.7 GB 8GB GPUMac 16GB Commercial with conditions2025-04-28
Llama-Guard-4-12B12B — 26.9 GB8.5 GB 12GB GPUMac 16GB Commercial with conditions2025-04-23
Llama-Guard-3-1B1.5B — 3.8 GB1.5 GB 8GB GPUMac 16GB Commercial with conditions2024-09-20
Llama-Guard-3-11B-Vision ↗10.7B — 24.0 GB7.6 GB 12GB GPUMac 16GB Commercial with conditions2024-09-20
Llama-Guard-3-8B8.03B — 18.2 GB5.9 GB 8GB GPUMac 16GB Commercial with conditions2024-07-22
Prompt-Guard-86M279M — 1.1 GB0.7 GB 8GB GPUMac 16GB Commercial with conditions2024-07-21

04Other families

Qwen · IBM Granite · NVIDIA Nemotron · Gemma · Mistral / Magistral / Devstral · GLM / CogVideoX (Z.ai) · DeepSeek · Ai2 OLMo / Molmo · Ant Ling / Ring / Ming · Liquid LFM · MiniCPM / VoxCPM · Tencent Hunyuan / Hy · Phi · Meituan LongCat · Jina embeddings & rerankers · Wan · Kimi · Cohere Command / Aya · Xiaomi MiMo · FLUX · Microsoft VibeVoice / Fara / Harrier · InternLM / Intern-S · StepFun Step · MiniMax · Baidu ERNIE · NVIDIA Parakeet / Canary speech · Stable Diffusion / Stable Audio · Yi (01.AI) · ByteDance Seed · SmolLM / SmolVLM · BGE embeddings & rerankers · LTX Video · FunAudioLLM speech · gpt-oss · poolside Laguna · Whisper · Baichuan · Thinking Machines Inkling · xAI Grok · rednote dots

Totals include 10% + 0.5GB overhead and one 8K-token KV cache for text models. Estimates only. Method →

Data updated: Self-host open models(UTC+8)