// I want to solve · Enterprise IT / Small teams & business

🏢 Private LLMs and knowledge bases for the enterprise

Deploy chat, knowledge-base and agent platforms on your intranet or private cloud: choose models and inference engines, size hardware, set permissions and audit, and check compliance in China.

6 steps5 alternatives5 stacks · 2 problemschecked 2026-10-22

How to do it

01Classify data first: what may use public cloud APIs under an enterprise no-training agreement, and what must stay private
02Shortlist 2–3 models with our model picker and open-weight lists, then test them on your own tasks
03Size GPUs with our VRAM calculator and compute guides; use vLLM or SGLang in production, Ollama for pilots
04On top: Open WebUI / LibreChat for chat, Dify / RAGFlow / FastGPT / MaxKB for knowledge bases and apps, wired to company SSO
05Route all calls through LiteLLM with departmental budgets, keep audit logs in Langfuse, and test prompt injection and access control before launch
06Public-facing generative AI services in mainland China need filing/registration; internal-only use still needs a compliance review

What it costs

Pilot

One workstation with 24–48 GB VRAM plus open-source software is enough to validate (see self-hosted compute for models)

Department

Multi-GPU servers or hourly cloud GPUs; software is open source, operations staff are the main cost

Company-wide

Needs an HA cluster, gateway and audit; compare total cost with public-cloud enterprise plans before deciding

Prices change; the vendor’s official page wins. Subscriptions compared · API prices

Alternatives: which to pick

Option	Choose it when
Dify	Build knowledge Q&A and AI apps visually
RAGFlow	Complex documents (tables, scans) where parsing quality matters
FastGPT / MaxKB	Active Chinese communities with many local deployments
Open WebUI / LibreChat	You only need one internal chat front door
公有云企业版（ChatGPT Enterprise、Gemini for Workspace 等）	Data may leave your network and you want no operations

✓ Good fit

Enterprises with sensitive data, intranet requirements, audit and chargeback

✗ Not a good fit

Small teams without ops staff: start with a public-cloud enterprise plan

Ready-made stacks

All stacks

Enterprise RAG knowledge baseAdvanced Team-scale document Q&A: deep document parsing, a scalable vector database, one model gateway, plus tracing and quality evaluation. 6 tools Enterprise knowledge RAG Governed RAG over company docs, tickets and wikis with permissions and observability. 4 tools Air-gapped / intranet Chat, knowledge base and coding help with no internet egress. 4 tools Low-code AI workflowsBeginner Build AI apps and automations by drag and drop, self-hostable, for teams that do not want to code from scratch. 4 tools Model gateway & cost controlIntermediate One endpoint for every model: budgets and rate limits per team, automatic fallback, and clear spend per person and project. 5 tools

Software that helps

All software

dify Workflow & agent platforms1.17.1 ★ 159k Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack. Open source API ragflow Document parsing & web scrapingnightly ★ 93k RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs Open source API fastgpt Workflow & agent platforms ★ 30k FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and Open source maxkb Workflow & agent platforms ★ 23k 🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。 Open source open-webui AI apps & chat clientsv0.11.4 ★ 156k User-friendly AI Interface (Supports Ollama, OpenAI API, ...) Open source API LibreChat AI apps & chat clientschart-2.0.17 ★ 46k Enhanced ChatGPT Clone: Features Agents, MCP, Skills, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, Code Interpreter, langchain, DALL-E-3, OpenAPI Actions, Functions, Secure Multi-User Auth, Presets, open-source for self-hosting. Active Open source API vllm Local inference & servingv0.31.0 ★ 95k A high-throughput and memory-efficient inference and serving engine for LLMs Open source APICLI sglang Local inference & servingv0.5.21 ★ 38k SGLang is a high-performance serving framework for large language models and multimodal models. Open source API Ollama Local inference & servingv0.40.8 ★ 184k Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Open source CLIAPI litellm Model gateways, routing & usagev1.104.2 ★ 62k The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] Open source SDKAPI langfuse Observability & tracingv4.56.0 ★ 36k 🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. Open source SDKAPI milvus Retrieval, vector DBs & embeddingsv3.0.3 ★ 46k Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search Open source APISDK MinerU Document parsing & web scrapingmineru-4.0.11-released ★ 82k Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows. Open source CLIAPI

Problems & solutions

All problems

Needs in this scenario

ENT-02Enterprise admission: certifications, data residency, SSO/SCIM, SLA, exit terms

Enterprise IT · People search for: is x soc 2 compliant; self-hosted llm observability; data residency
ENT-04Transparent TCO and residency matrix

Enterprise IT · People search for: llm observability pricing; ai gateway tco
ENT-05China compliance: filing, domestic IT stacks, bundled tenders

Enterprise IT · People search for: china generative ai filing; ai regulation china
ENT-01Choosing the control plane: gateways, observability, security, identity

Enterprise IT · People search for: enterprise llm gateway comparison; ai observability platform

Official references

Compiled from official documentation on 2026-10-22; not reproduced in our own environment. Follow the official docs if they differ.