Skip to content
English

Switch theme

// Microsoft VibeVoice / Fara / Harrier · Speech-to-text

VibeVoice-ASR: VRAM & local deployment

8.67B parameters. About 6.3 GB at 4-bit and 19.6 GB at BF16.

released 2026-01-21licence: Commercial OKmemory figures are estimates

01Specs

PublisherMicrosoft · microsoft
Family / seriesMicrosoft VibeVoice / Fara / Harrier · VibeVoice-ASR
TypeSpeech-to-text (automatic-speech-recognition)
Parameters8.67B Source: counted from official safetensors weights
Released weightsBF16 · 17.4 GBdownload
LicenceMIT · Commercial OKPermissive licence (Apache-2.0 / MIT / CC-BY / OpenMDW): commercial use allowed.
Released2026-01-21 (Hugging Face repo created)

02How much VRAM it needs (estimate)

Speech models are small; the weight size is close to the total memory needed.

PrecisionWeightsWeights + overheadSmallest GPUMac
BF16 / FP16 (original)17.4 GB 19.6 GB RTX 4090 24GBMac 36GB
FP8 / INT8 / Q8_09.2 GB 10.6 GB 12GB GPUMac 24GB
4-bit (Q4_K_M / AWQ / GPTQ-Int4)5.3 GB 6.3 GB 8GB GPUMac 16GB

Bits per weight: BF16 16, FP8 8.5, 4-bit 4.85. “Fits” = total ≤ 90% of memory; Mac GPU can use ~2/3 of unified memory (≤36GB) or ~3/4 (larger). For MoE, all experts must be in memory, so size by total parameters. Method →

03How to run it

Only runtimes the publisher or the runtime’s official library names for this model.

Which inference engine to choose →

04Official repositories & quantised builds

2 official repo(s) from microsoft.

05Other Microsoft VibeVoice / Fara / Harrier models

All 12 →
ModelParams4-bit totalReleased
VibeVoice-ASR-Streaming-1.5B2.81B2.4 GB2026-09-02
VibeVoice-ASR-Streaming-7B8.67B6.3 GB2026-09-02
Fara1.5-4B4.54B3.8 GB2026-07-17
Fara1.5-27B27.4B19.3 GB2026-07-17
Fara1.5-9B9.41B7.0 GB2026-05-12
harrier-oss-v1-270m268M0.7 GB2026-03-30
harrier-oss-v1-0.6b596M0.9 GB2026-03-30
harrier-oss-v1-27b27B18.5 GB2026-03-30

06Sources

Data checked 2026-01-27. Parameters, context and licence are copied from the official repository; memory figures are our estimates.

Data updated: Self-host open models(UTC+8)