Skip to content
English

Switch theme

// Stable Diffusion / Stable Audio · Text LLM

sv4d2.0: VRAM & local deployment

Text LLM model published by Stability AI.

released 2025-02-20licence: Commercial with conditionsmemory figures are estimates

01Specs

PublisherStability AI · stabilityai
Family / seriesStable Diffusion / Stable Audio · sv4d2.0
TypeText LLM
Parametersnot stated in official metadata
Context length—
Licencestabilityai-ai-community · Commercial with conditionsCommercial use allowed under the publisher’s own licence terms (user caps, acceptable-use policy, attribution or region limits). Read it before shipping.
Released2025-02-20 (Hugging Face repo created)

02How much VRAM it needs (estimate)

Total = weights + 10% + 0.5GB overhead + KV cache for one request (FP16 KV). More concurrent users multiply the KV column.

No estimate: the official metadata does not give a parameter count. Check the model card for tested hardware.

Bits per weight: BF16 16, FP8 8.5, 4-bit 4.85. “Fits” = total ≤ 90% of memory; Mac GPU can use ~2/3 of unified memory (≤36GB) or ~3/4 (larger). For MoE, all experts must be in memory, so size by total parameters. Method →

03How to run it

Only runtimes the publisher or the runtime’s official library names for this model.

Which inference engine to choose →

04Official repositories & quantised builds

1 official repo(s) from stabilityai.

05Other Stable Diffusion / Stable Audio models

All 10 →
ModelParams4-bit totalReleased
stable-audio-3-medium2.31B2.0 GB2026-05-17
stable-audio-3-small-music568M0.9 GB2026-05-17
stable-audio-3-small-sfx568M0.9 GB2026-05-17
stable-audio-open-small497M0.8 GB2025-05-12
stable-diffusion-3.5-medium2.47B2.1 GB2024-10-29
stable-diffusion-3.5-large8.15B5.9 GB2024-10-22
stable-diffusion-3.5-large-turbo8.15B5.9 GB2024-10-22
stable-diffusion-3-medium-diffusers2.08B1.9 GB2024-06-12

06Sources

Data checked 2025-04-04. Parameters, context and licence are copied from the official repository; memory figures are our estimates.

Data updated: Self-host open models(UTC+8)