// Read docs & web pages
Scraplingv0.4.15
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Open source Maintained For agents
IN ONE PARAGRAPH
Scrapling is 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev.
Good for: Developers who want their agent (Claude Code, Codex, Cursor…) to read docs & web pages.
01How to start
- 1Read the official README for requirements and permissions.
- 2Install it from the official package registry:
pip install scrapling - 3Tell your agent the command exists (e.g. in AGENTS.md / CLAUDE.md) so it knows when to call it.
02Alternatives & comparison
Compare side by side → Scrapegraph-ai Python scraper based on AI ★ 32k scrapy Scrapy, a fast high-level web crawling & scraping framework for Python. ★ 65k crawlee Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation. ★ 26k firecrawl Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥 ★ 194k crawl4ai Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. ★ 86k