// Open-model VRAM table · family
IBM Granite: local deployment & VRAM
67 open-weight models from IBM (147 official repos incl. quantised builds). At 4-bit they range from 0.8 GB (granite-4.0-h-350m) to 22.7 GB (granite-switch-4.1-30b).
official orgs: ibm-granitelatest 2026-10-14memory = estimate
01Text LLM (32)
| Model | Params | Context | BF16 | 4-bit | Smallest GPU (4-bit) | Mac (4-bit) | Licence | Released |
|---|---|---|---|---|---|---|---|---|
| granite-switch-4.1-8b | 8.78B | 128K | 21.2 GB | 7.8 GB | 12GB GPU | Mac 16GB | Commercial OK | 2026-10-14 |
| granite-switch-4.1-30b | 30B | 128K | 68.7 GB | 22.7 GB | RTX 5090 32GB | Mac 64GB | Commercial OK | 2026-10-14 |
| ensemble-forecasting-with-ibm-granite-time-series | — | — | — | — | — | — | Licence not stated | 2026-10-01 |
| granite-4.2-3b | 3.66B | 128K | 9.2 GB | 3.6 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-08-07 |
| granite-4.2-8b | 8.79B | 128K | 21.2 GB | 7.7 GB | 12GB GPU | Mac 16GB | Commercial OK | 2026-08-07 |
| granite-4.2-30b | 29.3B | 128K | 67.1 GB | 22.2 GB | RTX 5090 32GB | Mac 64GB | Commercial OK | 2026-08-07 |
| granite-4.1-3b | 3.4B | 128K | 8.7 GB | 3.4 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-04-06 |
| granite-4.1-8b | 8.79B | 128K | 21.2 GB | 7.7 GB | 12GB GPU | Mac 16GB | Commercial OK | 2026-04-06 |
| granite-4.1-30b | 28.9B | 128K | 66.2 GB | 21.9 GB | RTX 5090 32GB | Mac 64GB | Commercial OK | 2026-04-06 |
| granitelib-core-r1.0 | — | — | — | — | — | — | Commercial OK | 2025-12-10 |
| granite-4.0-350m | 352M | 32K | 1.5 GB | 1.0 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-10-07 |
| granite-4.0-1b | 1.63B | 128K | 4.8 GB | 2.3 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-10-07 |
| granite-4.0-h-350m | 340M | 32K | 1.3 GB | 0.8 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-10-07 |
| granite-4.0-h-1b | 1.46B | 128K | 3.8 GB | 1.5 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-10-07 |
| granite-4.0-h-micro | 3.19B | 128K | 7.6 GB | 2.7 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-09-16 |
| granite-4.0-h-small | 32.2B | 128K | 71.5 GB | 22.1 GB | RTX 5090 32GB | Mac 64GB | Commercial OK | 2025-09-16 |
| granite-4.0-h-tiny | 6.94B | 128K | 15.8 GB | 5.2 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-09-16 |
| granite-4.0-micro | 3.4B | 128K | 8.7 GB | 3.4 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-09-16 |
| granite-4.0-tiny-preview | 6.67B | 128K | 15.2 GB | 5.0 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-04-30 |
| granite-3.3-2b-instruct | 2.53B | 128K | 6.7 GB | 2.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-04-09 |
| granite-3.3-8b-instruct | 8.17B | 128K | 19.8 GB | 7.3 GB | 12GB GPU | Mac 16GB | Commercial OK | 2025-04-09 |
| granite-3.2-2b-instruct | 2.53B | 128K | 6.7 GB | 2.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-02-17 |
| granite-3.2-8b-instruct | 8.17B | 128K | 19.8 GB | 7.3 GB | 12GB GPU | Mac 16GB | Commercial OK | 2025-02-17 |
| granite-3.1-2b-instruct | 2.53B | 128K | 6.7 GB | 2.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-12-06 |
| granite-3.1-8b-instruct | 8.17B | 128K | 19.8 GB | 7.3 GB | 12GB GPU | Mac 16GB | Commercial OK | 2024-12-06 |
| granite-3.1-1b-a400m-instruct | 1.33B | 128K | 3.8 GB | 1.8 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-12-06 |
| granite-3.1-3b-a800m-instruct | 3.3B | 128K | 8.3 GB | 3.2 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-12-06 |
| granite-3.0-1b-a400m-instruct | 1.33B / 400M | 4K | 3.8 GB | 1.8 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-10-03 |
| granite-3.0-3b-a800m-instruct | 3.37B / 800M | 4K | 8.5 GB | 3.3 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-10-03 |
| granite-3.0-2b-instruct | 2.63B | 4K | 7.0 GB | 2.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-10-02 |
| granite-3.0-8b-instruct | 8.17B | 4K | 19.8 GB | 7.3 GB | 12GB GPU | Mac 16GB | Commercial OK | 2024-10-02 |
| granite-8b-code-instruct-128k ↗ | 8.05B | 125K | 19.4 GB | 7.1 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-07-12 |
02Vision-language (5)
| Model | Params | Context | BF16 | 4-bit | Smallest GPU (4-bit) | Mac (4-bit) | Licence | Released |
|---|---|---|---|---|---|---|---|---|
| granite-vision-4.1-4b | 4B | 128K | 10.0 GB | 3.8 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-04-16 |
| granite-4.0-3b-vision | 4B | 128K | 10.0 GB | 3.8 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-03-03 |
| granite-vision-3.3-2b | 2.98B | 128K | 7.7 GB | 3.2 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-06-03 |
| granite-docling-258M | 258M | 8K | 1.3 GB | 0.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-05-19 |
| granite-vision-3.2-2b | 2.98B | 128K | 7.7 GB | 3.2 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-02-17 |
03Embedding (10)
| Model | Params | BF16 | 4-bit | Smallest GPU (4-bit) | Mac (4-bit) | Licence | Released |
|---|---|---|---|---|---|---|---|
| granite-embedding-97m-multilingual-r2 | 97M | 0.7 GB | 0.6 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-04-20 |
| granite-embedding-311m-multilingual-r2 | 312M | 1.2 GB | 0.7 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-04-20 |
| granite-speech-4.1-2b-nar | 2.25B | 5.5 GB | 2.0 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-03-10 |
| granite-embedding-english-r2 | 149M | 0.8 GB | 0.6 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-07-17 |
| granite-embedding-small-english-r2 | 48M | 0.6 GB | 0.5 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-07-17 |
| granite-embedding-30m-sparse | 30M | 0.6 GB | 0.5 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-02-17 |
| granite-embedding-30m-english | 30M | 0.6 GB | 0.5 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-12-04 |
| granite-embedding-125m-english | 125M | 0.8 GB | 0.6 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-12-04 |
| granite-embedding-107m-multilingual | 107M | 0.7 GB | 0.6 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-12-04 |
| granite-embedding-278m-multilingual | 278M | 1.1 GB | 0.7 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-12-04 |
04Reranker (1)
| Model | Params | BF16 | 4-bit | Smallest GPU (4-bit) | Mac (4-bit) | Licence | Released |
|---|---|---|---|---|---|---|---|
| granite-embedding-reranker-english-r2 | 150M | 0.8 GB | 0.6 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-08-04 |
05Speech-to-text (9)
| Model | Params | BF16 | 4-bit | Smallest GPU (4-bit) | Mac (4-bit) | Licence | Released |
|---|---|---|---|---|---|---|---|
| granite-speech-5.0-2b | 2.31B | 5.6 GB | 2.0 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-10-07 |
| granite-speech-5.0-470m-turboctc-nc | 473M | 1.5 GB | 0.8 GB | 8GB GPU | Mac 16GB | Non-commercial | 2026-08-17 |
| granite-speech-5.0-470m-turboctc | 473M | 1.5 GB | 0.8 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-08-04 |
| granite-speech-4.1-2b | 2.31B | 5.6 GB | 2.0 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-04-16 |
| granite-speech-4.1-2b-plus | 2.11B | 5.1 GB | 1.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-04-16 |
| granite-4.0-1b-speech | 2.31B | 5.6 GB | 2.0 GB | 8GB GPU | Mac 16GB | Commercial OK | 2026-02-27 |
| granite-speech-3.3-2b | 3.01B | 7.1 GB | 2.5 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-04-28 |
| granite-speech-3.3-8b | 8.65B | 19.5 GB | 6.3 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-04-14 |
| granite-speech-3.2-8b | 8.48B | 19.2 GB | 6.2 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-03-26 |
06Safety / guard (10)
| Model | Params | Context | BF16 | 4-bit | Smallest GPU (4-bit) | Mac (4-bit) | Licence | Released |
|---|---|---|---|---|---|---|---|---|
| granite-guardian-4.1-8b | 8.38B | 128K | 20.3 GB | 7.4 GB | 12GB GPU | Mac 16GB | Commercial OK | 2026-04-16 |
| granitelib-guardian-r1.0 ↗ | — | — | — | — | — | — | Commercial OK | 2026-02-02 |
| granite-guardian-3.3-8b | 8.17B | 128K | 19.8 GB | 7.3 GB | 12GB GPU | Mac 16GB | Commercial OK | 2025-06-03 |
| granite-guardian-3.2-3b-a800m ↗ | 3.3B | 128K | 8.3 GB | 3.2 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-02-03 |
| granite-guardian-3.2-5b ↗ | 5.78B | 128K | 14.2 GB | 5.3 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-01-23 |
| granite-guardian-3.1-2b ↗ | 2.53B | 128K | 6.7 GB | 2.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-12-17 |
| granite-guardian-3.1-8b ↗ | 8.17B | 128K | 19.8 GB | 7.3 GB | 12GB GPU | Mac 16GB | Commercial OK | 2024-12-17 |
| granite-guardian-3.0-2b | 2.53B | 8K | 6.7 GB | 2.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-10-15 |
| granite-guardian-hap-38m ↗ | 38M | 1K | 0.7 GB | 0.6 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-09-05 |
| granite-guardian-hap-125m ↗ | 125M | 1K | 1.1 GB | 0.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-09-05 |
07Other families
Qwen · NVIDIA Nemotron · Gemma · Mistral / Magistral / Devstral · GLM / CogVideoX (Z.ai) · DeepSeek · Ai2 OLMo / Molmo · Ant Ling / Ring / Ming · Liquid LFM · MiniCPM / VoxCPM · Tencent Hunyuan / Hy · Phi · Llama · Meituan LongCat · Jina embeddings & rerankers · Wan · Kimi · Cohere Command / Aya · Xiaomi MiMo · FLUX · Microsoft VibeVoice / Fara / Harrier · InternLM / Intern-S · StepFun Step · MiniMax · Baidu ERNIE · NVIDIA Parakeet / Canary speech · Stable Diffusion / Stable Audio · Yi (01.AI) · ByteDance Seed · SmolLM / SmolVLM · BGE embeddings & rerankers · LTX Video · FunAudioLLM speech · gpt-oss · poolside Laguna · Whisper · Baichuan · Thinking Machines Inkling · xAI Grok · rednote dots
Totals include 10% + 0.5GB overhead and one 8K-token KV cache for text models. Estimates only. Method →