Skip to content
English

Switch theme

Discover▾

Not sure where to start? This week’s hottest software, models and stacks in three minutes.

AI Apps▾

AI software people use: from assistants like ChatGPT to tools for coding, video and workflows, picked by purpose.

For Agents▾

Software for AI: tools that let your agent (Claude Code, Codex, Cursor…) browse, read docs, run code and remember.

Models▾

Choose models, estimate cost, self-host: prices, rankings, benchmarks, free tiers and compute.

Solutions▾

A goal or an error message? Ready-made stacks, steps and fixes by scenario.

Learn▾

A systematic course from zero to the frontier, with an algorithm library, must-read papers and tutorials.

Frontier▾

Daily AI news, weekly highlights, the latest papers and how AI is changing every discipline.

// Run models locally

DeepInfer

The open-source release of the inference framework behind DeepSeek’s production services (repo created 2026-10-16, ~18k stars in a week): currently DeepSeek-V4.1-Flash only, offering offline inference with the core features for serving at scale — FlashMLA / DeepGEMM / DeepEP kernels, attention DP + MoE EP/EPLB, draft-token decoding (DSpark), async scheduling, batch-invariant and deterministic sampling, structured outputs. Runs on NVIDIA SM100 (Blackwell) and Huawei Ascend 950 only; the KV-cache system, prefill/decode disaggregation and load balancing needed for a full online service are not included

Open source Maintained For developers

Official site ↗ Compare

IN ONE PARAGRAPH

DeepInfer is the open-source release of the inference framework behind DeepSeek’s production services (repo created 2026-10-16, ~18k stars in a week): currently DeepSeek-V4.1-Flash only, offering offline inference with the core features for serving at scale — FlashMLA / DeepGEMM / DeepEP kernels, attention DP + MoE EP/EPLB, draft-token decoding (DSpark), async scheduling, batch-invariant and deterministic sampling, structured outputs. Runs on NVIDIA SM100 (Blackwell) and Huawei Ascend 950 only; the KV-cache system, prefill/decode disaggregation and load balancing needed for a full online service are not included.

Good for: Developers and teams who want to run models locally.

01How to start

  1. 1Read the official quick-start (link above).
  2. 2Install or sign up as the official guide describes.
  3. 3Try it on a small example before wiring it into a project.

02Alternatives & comparison

Compare side by side →
Ollama Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. ★ 184k llama.cpp LLM inference in C/C++ ★ 132k vllm A high-throughput and memory-efficient inference and serving engine for LLMs ★ 95k cherry-studio AI productivity studio with smart chat, autonomous agents, and 300+ assistants. Unified access to frontier LLMs ★ 53k LocalAI LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. ★ 50k

03Related

Versions, why it is listed, for AI to read

For AI agents

Data updated: AI software & hot ranks · Software profiles & needs(UTC+8)