// Open-model VRAM table · family
BGE embeddings & rerankers: local deployment & VRAM
8 open-weight models from BAAI (8 official repos incl. quantised builds).
official orgs: BAAIlatest 2025-05-15memory = estimate
01Embedding (6)
| Model | Params | BF16 | 4-bit | Smallest GPU (4-bit) | Mac (4-bit) | Licence | Released |
|---|---|---|---|---|---|---|---|
| bge-code-v1 | 1.54B | 3.9 GB | 1.5 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-05-15 |
| BGE-VL-base ↗ | 150M | 0.8 GB | 0.6 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-02-25 |
| BGE-VL-large ↗ | 428M | 1.4 GB | 0.8 GB | 8GB GPU | Mac 16GB | Commercial OK | 2025-02-25 |
| bge-en-icl ↗ | 7.11B | 16.1 GB | 5.2 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-07-25 |
| bge-multilingual-gemma2 | 9.24B | 20.8 GB | 6.7 GB | 8GB GPU | Mac 16GB | Commercial with conditions | 2024-07-25 |
| bge-m3 | — | — | — | — | — | Commercial OK | 2024-01-27 |
02Reranker (2)
| Model | Params | BF16 | 4-bit | Smallest GPU (4-bit) | Mac (4-bit) | Licence | Released |
|---|---|---|---|---|---|---|---|
| bge-reranker-v2.5-gemma2-lightweight | 9.24B | 20.8 GB | 6.7 GB | 8GB GPU | Mac 16GB | Commercial with conditions | 2024-07-25 |
| bge-reranker-v2-m3 | 568M | 1.7 GB | 0.9 GB | 8GB GPU | Mac 16GB | Commercial OK | 2024-03-15 |
03Other families
Qwen · IBM Granite · NVIDIA Nemotron · Gemma · Mistral / Magistral / Devstral · GLM / CogVideoX (Z.ai) · DeepSeek · Ai2 OLMo / Molmo · Ant Ling / Ring / Ming · Liquid LFM · MiniCPM / VoxCPM · Tencent Hunyuan / Hy · Phi · Llama · Meituan LongCat · Jina embeddings & rerankers · Wan · Kimi · Cohere Command / Aya · Xiaomi MiMo · FLUX · Microsoft VibeVoice / Fara / Harrier · InternLM / Intern-S · StepFun Step · MiniMax · Baidu ERNIE · NVIDIA Parakeet / Canary speech · Stable Diffusion / Stable Audio · Yi (01.AI) · ByteDance Seed · SmolLM / SmolVLM · LTX Video · FunAudioLLM speech · gpt-oss · poolside Laguna · Whisper · Baichuan · Thinking Machines Inkling · xAI Grok · rednote dots
Totals include 10% + 0.5GB overhead and one 8K-token KV cache for text models. Estimates only. Method →