Skip to content
English

Switch theme

// Run models locally

airllm

Run 70B inference on a single 4GB GPU.

Open source Maintained Dual-use For developers

IN ONE PARAGRAPH

airllm is run 70B inference on a single 4GB GPU.

Good for: Developers and teams who want to run models locally.

01How to start

  1. 1Read the official quick-start (link above).
  2. 2Install or sign up as the official guide describes.
  3. 3Try it on a small example before wiring it into a project.

02Alternatives & comparison

Compare side by side →

03Related

Versions, why it is listed, for AI to read

Popularity evidence (third-party snapshots)

For AI agents

Data updated: AI software & hot ranks · Software profiles & needs · Official software downloads(UTC+8)