// Switch models, control cost
any-llm1.33.0
Communicate with an LLM provider using a single interface
Open source Maintained For agents
IN ONE PARAGRAPH
any-llm is communicate with an LLM provider using a single interface.
Good for: Developers who want their agent (Claude Code, Codex, Cursor…) to switch models, control cost.
01How to start
- 1Read the official README for requirements and permissions.
- 2Install it from the official package registry:
pip install any-llm-sdk - 3Tell your agent the command exists (e.g. in AGENTS.md / CLAUDE.md) so it knows when to call it.
02Alternatives & comparison
Compare side by side → litellm The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] ★ 62k agent-router Manages Unified Access to Generative AI Services built on Envoy Gateway ★ 2.2k ai-gateway The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced. ★ 636 new-api A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management. ★ 50k kong 🦍 The API and AI Gateway ★ 44k
03Related
- ›Ollama 文档 · OllamaEnglish
- ›handy-ollama 动手学 Ollama · DatawhaleChinese
- ›vLLM 文档 · vLLMEnglish
- ›SGLang 文档 · SGLangEnglish
- ›llama.cpp · ggml-orgEnglish
- All tutorials →