Skip to content
English

Switch theme

// Microsoft VibeVoice / Fara / Harrier · Speech-to-text

VibeVoice-ASR-Streaming-7B: VRAM & local deployment

8.67B parameters. About 6.3 GB at 4-bit and 19.6 GB at BF16.

released 2026-09-02licence: Commercial OKmemory figures are estimates

01Specs

PublisherMicrosoft · microsoft
Family / seriesMicrosoft VibeVoice / Fara / Harrier · VibeVoice-ASR-Streaming
TypeSpeech-to-text (automatic-speech-recognition)
Parameters8.67B Source: counted from official safetensors weights
Released weightsBF16 · 17.4 GBdownload
LicenceMIT · Commercial OKPermissive licence (Apache-2.0 / MIT / CC-BY / OpenMDW): commercial use allowed.
Released2026-09-02 (Hugging Face repo created)

02How much VRAM it needs (estimate)

Speech models are small; the weight size is close to the total memory needed.

PrecisionWeightsWeights + overheadSmallest GPUMac
BF16 / FP16 (original)17.4 GB 19.6 GB RTX 4090 24GBMac 36GB
FP8 / INT8 / Q8_09.2 GB 10.6 GB 12GB GPUMac 24GB
4-bit (Q4_K_M / AWQ / GPTQ-Int4)5.3 GB 6.3 GB 8GB GPUMac 16GB

Bits per weight: BF16 16, FP8 8.5, 4-bit 4.85. “Fits” = total ≤ 90% of memory; Mac GPU can use ~2/3 of unified memory (≤36GB) or ~3/4 (larger). For MoE, all experts must be in memory, so size by total parameters. Method →

03How to run it

Only runtimes the publisher or the runtime’s official library names for this model.

Which inference engine to choose →

04Official repositories & quantised builds

1 official repo(s) from microsoft.

05Other Microsoft VibeVoice / Fara / Harrier models

All 12 →
ModelParams4-bit totalReleased
VibeVoice-ASR-Streaming-1.5B · same series2.81B2.4 GB2026-09-02
Fara1.5-4B4.54B3.8 GB2026-07-17
Fara1.5-27B27.4B19.3 GB2026-07-17
Fara1.5-9B9.41B7.0 GB2026-05-12
harrier-oss-v1-270m268M0.7 GB2026-03-30
harrier-oss-v1-0.6b596M0.9 GB2026-03-30
harrier-oss-v1-27b27B18.5 GB2026-03-30
VibeVoice-ASR8.67B6.3 GB2026-01-21
VibeVoice-Realtime-0.5B1.02B1.2 GB2025-12-04

06Sources

Data checked 2026-09-03. Parameters, context and licence are copied from the official repository; memory figures are our estimates.

Data updated: Self-host open models(UTC+8)