// Document parsing & web scraping
Read docs & web pages
Turn PDFs, Office files and web pages into clean text agents can read.
65 tools60 open sourcechecked 2026-10-22Compare side by side →
How to choose · start with these three
- · Office/PDF to text: MarkItDown is light, Docling handles tables/layout better
- · Whole-site crawling: Firecrawl, Crawl4AI
- · Scans need OCR-capable tools
65 / 65 items
MarkItDown v0.1.9 ★ 191k Microsoft tool converting office documents to Markdown for LLMs. Open source CLIPythonSDK firecrawl v2.11.502 ★ 194k Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥 Open source APISDK docling v2.137.0 ★ 69k Get your documents ready for gen AI Open source CLISDKMCP Umi-OCR ★ 48k Free offline OCR for screenshots, batch images and PDFs. Open source WindowsmacOSLinux PDFMathTranslate ★ 38k PDF scientific paper translation that preserves layout. Open source localWeb opendataloader-pdf v2.5.14 ★ 30k PDF parser for AI-ready data. Open source CLISDK chandra ★ 13k OCR model for complex tables, forms and handwriting. Open source model BabelDOC ★ 9.7k Yet another document translator. Open source CLI unstract v0.195.0 ★ 7.3k LLM-driven extraction of unstructured data for APIs and ETL. Open source server Stirling-PDF v3.1.0 ★ 94k #1 PDF Application on GitHub that lets you edit PDFs on any device anywhere Open source API ragflow nightly ★ 93k RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs Open source API PaddleOCR v3.7.0 ★ 91k Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages. Open source SDKCLI mermaid [email protected] ★ 91k Generation of diagrams like flowcharts or sequence diagrams from text in a similar manner as markdown Open source SDKCLI Scrapling v0.4.15 ★ 89k 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev Open source SDK crawl4ai v0.9.4 ★ 86k Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Open source SDKAPI MinerU mineru-4.0.11-released ★ 82k Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows. Open source CLIAPI tesseract 5.5.3 ★ 77k Tesseract Open Source OCR Engine (main repository) Open source CLI scrapy 2.19.0 ★ 65k Scrapy, a fast high-level web crawling & scraping framework for Python. Open source SDKCLI typst v0.15.1 ★ 56k A markup-based typesetting system that is powerful and easy to learn. Open source CLI pandoc 3.12.1 ★ 47k Universal markup converter Open source CLI marker v2.0.0 ★ 41k Convert PDF to markdown + JSON quickly with high accuracy Open source CLI LightRAG v1.5.7 ★ 40k [EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation Open source SDKAPI searxng v1.0.0 ★ 39k SearXNG is a free internet metasearch engine which aggregates results from various search services and databases. Users are neither tracked nor profiled. Open source API Vane v1.12.2 ★ 38k Vane is an AI-powered answering engine. Open source API graphrag v3.3.0 ★ 36k A modular graph-based Retrieval-Augmented Generation (RAG) system Open source CLISDK OCRmyPDF v17.13.0 ★ 35k OCRmyPDF adds an OCR text layer to scanned PDF files, allowing them to be searched Open source CLI Scrapegraph-ai v2.3.1 ★ 32k Python scraper based on AI Open source SDK EasyOCR v1.7.2 ★ 30k Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc. Open source SDK crawlee v3.18.2 ★ 26k Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation. Open source SDK DeepSeek-OCR ★ 24k Contexts Optical Compression Open source Model postgres REL_18_6 ★ 22k Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see https://wiki.postgresql.org/wiki/Submitting_a_Patch Open source SQL surya v0.22.1 ★ 22k OCR, layout analysis, reading order, table recognition in 90+ languages Open source CLI olmocr v0.4.27 ★ 20k Toolkit for linearizing PDFs for LLM datasets/training Open source CLI SurfSense v2.2.3 ★ 17k Air gapped, privacy focused open source NotebookLM alternative. Join our Discord: https://discord.gg/ejRNvftDp9 Open source API unstructured 0.27.33 ★ 16k Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding. Open source SDKAPI plantuml v1.2026.8 ★ 13k Generate diagrams from textual description Open source CLI FlagEmbedding v1.4.2 ★ 12k Retrieval and Retrieval-augmented LLMs Open source SDK reader ★ 12k Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/ Open source API readability 0.6.0 ★ 11k A standalone version of the readability lib Open source SDK turndown v7.2.4 ★ 11k 🛏 An HTML to Markdown converter written in JavaScript Open source SDK PyMuPDF 1.28.2 ★ 11k PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents. Open source SDK pdfplumber v0.11.10 ★ 11k Plumb a PDF for detailed information about each char, rectangle, line, et cetera — and easily extract text and tables. Open source SDKCLI pypdf 6.20.0 ★ 10k A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files Open source SDK WeasyPrint v70.0 ★ 9.7k The awesome document factory Open source CLI xberg v1.3.7 ★ 9.4k Polyglot document intelligence with a Rust core: extract text, metadata, images, tables, and structured data from 106 formats across 140 file extensions, plus code intelligence for 371 languages. Fifteen bindings, with CLI, REST API, and MCP server. Open source SDKCLIMCP dots.ocr ★ 9.2k Multilingual Document Layout Parsing in a Single Vision-Language Model Open source Model trafilatura v2.3.1 ★ 7.0k Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML Open source CLISDK doctr v1.1.0 ★ 6.4k docTR (Document Text Recognition) - a seamless, high-performing & accessible library for OCR-related tasks powered by Deep Learning. Ongoing development and maintenance by t2k. Open source SDK quarto-cli v1.10.19 ★ 6.1k Open-source scientific and technical publishing system built on Pandoc. Open source CLI python-docx v1.2.0 ★ 5.7k Create and modify Word documents with Python Open source SDK qpdf v12.4.2 ★ 5.5k qpdf: A content-preserving PDF document transformer Open source CLI tika 4.1.0 ★ 4.1k The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF). Open source APICLI marp-cli v4.5.1 ★ 3.8k A CLI interface for Marp and Marpit based converters Open source CLI camelot v2.0.0 ★ 3.8k A Python library to extract tabular data from PDFs Open source SDKCLI mupdf 1.28.5 ★ 3.0k mupdf mirror Open source CLI poi REL_5_5_1 ★ 2.3k Mirror of Apache POI gitbox. The Java API for Microsoft Documents. Open source SDK docling-serve v1.36.0 ★ 1.8k Running Docling as an API service Open source API Brave Search API Closed / commercial Exa Closed / commercial Indra OCR A ~1M-parameter OCR model from Datalab (makers of Marker / Surya) that runs on CPU via ONNX Runtime: PDFs and images to Markdown, text or JSON with boxes, 80+ languages, handwriting and rotated pages, with layout blocks and reading order. Benchmarks are vendor-reported; model OpenRAIL-M, code Apache-2.0 Open source Pinecone Closed / commercial Poppler Open spec Tavily Closed / commercial Unlimited-OCR Baidu open document OCR / long-horizon parsing model (~3B): single image and multi-page PDF; Transformers / vLLM / SGLang; 1M+ HF downloads last month Open source yt-dlp 2026.08.19 ★ 195k A feature-rich command-line audio/video downloader Open source CLI
About this data
- Default order is “recommended”: editorial picks first, then by popularity; general-purpose developer software and archived projects are listed last.
- Data checked 2026-10-22. Official links only. JSON API