Skip to content
English

Switch theme

Discover▾

Not sure where to start? This week’s hottest software, models and stacks in three minutes.

AI Apps▾

AI software people use: from assistants like ChatGPT to tools for coding, video and workflows, picked by purpose.

For Agents▾

Software for AI: tools that let your agent (Claude Code, Codex, Cursor…) browse, read docs, run code and remember.

Models▾

Choose models, estimate cost, self-host: prices, rankings, benchmarks, free tiers and compute.

Solutions▾

A goal or an error message? Ready-made stacks, steps and fixes by scenario.

Learn▾

A systematic course from zero to the frontier, with an algorithm library, must-read papers and tutorials.

Frontier▾

Daily AI news, weekly highlights, the latest papers and how AI is changing every discipline.

// Software stack

Deep research agent

Build your own web research assistant: self-hosted search, page fetching, Markdown conversion, and an agent framework that writes the report.

5 pieces4 setup stepsscenario: Connect tools to agents (MCP, CLI, auth)

What goes in it

  1. 1

    gpt-researcher Agent frameworks & SDKs Open source

    Open-source deep research agent

    An autonomous agent that conducts deep research on any data using any LLM providers

    ★ 30k
  2. 2

    searxng Document parsing & web scraping Open source

    Self-hosted metasearch engine

    SearXNG is a free internet metasearch engine which aggregates results from various search services and databases. Users are neither tracked nor profiled.

    ★ 39k
  3. 3

    crawl4ai Document parsing & web scraping Open source

    LLM-friendly web crawler

    Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

    ★ 86k
  4. 4

    MarkItDown Document parsing & web scraping Open source

    Converts files to Markdown

    Microsoft tool converting office documents to Markdown for LLMs.

    ★ 191k
  5. 5

    langgraph optional Agent frameworks & SDKs Open source

    Orchestrates multi-step research flows

    Build resilient agents.

    ★ 44k

How to set it up

  1. 01Try built-in deep research in ChatGPT, Gemini or Perplexity first to confirm the need
  2. 02To self-host: SearXNG for search, Crawl4AI for fetching, MarkItDown for files
  3. 03Run GPT Researcher as is, or orchestrate search → read → write → cite-check yourself with LangGraph
  4. 04Every claim in the report needs a source link; spot-check by hand

✓ Good fit

  • You need controlled sources or internal data

✗ Look elsewhere if

  • Occasional research: use an off-the-shelf product

Data updated: AI software & hot ranks · Solutions & stack guides(UTC+8)