// Software stack

Air-gapped / intranet

Chat, knowledge base and coding help with no internet egress.

4 pieces4 setup stepsscenario: Private LLMs and knowledge bases for the enterprise

💡 The primary picks are now the mainstream offline option: vLLM (or Ollama) + Open WebUI / Dify, with models and images imported offline; the rest are trending alternatives.

What goes in it

1

vllm Local inference & serving Open source

Inference

A high-throughput and memory-efficient inference and serving engine for LLMs

Or: Ollama · OpenLLM · colibri · osaurus · LightLLM

★ 95k
2

open-webui AI apps & chat clients Open source

Knowledge base

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Or: dify · private-gpt · WeKnora · OpenKB

★ 156k
3

OpenCursor Coding agents & AI IDEs Open source

Coding

Open-source Cursor-like AI coding agent for VS Code.

Or: freebuff · ZCode

★ 6.0k
4

agent-governance-toolkit Identity, secrets & agent security Open source

Governance

AI Agent Governance Toolkit — policy, zero-trust identity, sandboxing.

Or: SkillSpector · agent-scan

★ 6.4k

How to set it up

01Import images and models offline
02Integrate intranet certificates and identity
03Block network by default and allow-list tools
04Red-team and scan skills before launch