// Software stack
Enterprise RAG knowledge base
Team-scale document Q&A: deep document parsing, a scalable vector database, one model gateway, plus tracing and quality evaluation.
6 pieces5 setup stepsscenario: Build RAG and process documents
What goes in it
- 1 ★ 93k
ragflow Document parsing & web scraping Open source
RAG engine and knowledge-base console
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
- 2 ★ 82k
MinerU Document parsing & web scraping Open source
Parses complex PDFs with tables and formulas
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
- 3 ★ 46k
milvus Retrieval, vector DBs & embeddings Open source
Distributed vector database
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
- 4 ★ 62k
litellm Model gateways, routing & usage Open source
One gateway to many models, with cost and rate limits
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
- 5 ★ 36k
langfuse Observability & tracing Open source
Traces retrieval and answers for quality evaluation
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
- 6 ★ 16k
ragas optional Evaluation, red-teaming & guardrails Open source
Evaluates RAG answer quality
Supercharge Your LLM Application Evaluations 🚀
How to set it up
- 01Inventory sources and permissions: which departments, which documents, who may see what
- 02Parse PDFs with tables and formulas using MinerU and spot-check the output by hand
- 03Deploy RAGFlow, create knowledge bases per department, use Milvus as the vector store
- 04Route every model call through LiteLLM with per-department budgets and rate limits
- 05Trace with Langfuse and run Ragas on a 50–100 question gold set before launch and weekly after
✓ Good fit
- Many documents, complex formats, many users and departments
- You need auditing and quality evaluation
✗ Look elsewhere if
- Just trying it out: start with the built-in knowledge base in Dify or Open WebUI