Skip to content
English

Switch theme

Discover▾

Not sure where to start? This week’s hottest software, models and stacks in three minutes.

AI Apps▾

AI software people use: from assistants like ChatGPT to tools for coding, video and workflows, picked by purpose.

For Agents▾

Software for AI: tools that let your agent (Claude Code, Codex, Cursor…) browse, read docs, run code and remember.

Models▾

Choose models, estimate cost, self-host: prices, rankings, benchmarks, free tiers and compute.

Solutions▾

A goal or an error message? Ready-made stacks, steps and fixes by scenario.

Learn▾

A systematic course from zero to the frontier, with an algorithm library, must-read papers and tutorials.

Frontier▾

Daily AI news, weekly highlights, the latest papers and how AI is changing every discipline.

// Evaluate & guard

VLMEvalKitv0.2

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

Open source Maintained For developers

Official site ↗ GitHub ↗

IN ONE PARAGRAPH

VLMEvalKit is open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks.

Good for: Developers and teams who want to evaluate & guard.

01How to start

  1. 1Read the official quick-start (link above).
  2. 2Install or sign up as the official guide describes.
  3. 3Try it on a small example before wiring it into a project.

02Alternatives & comparison

Compare side by side →
gorilla Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls) ★ 13k promptfoo Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic. ★ 26k ragas Supercharge Your LLM Application Evaluations 🚀 ★ 16k opencompass OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety. ★ 7.5k lmms-eval One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks ★ 4.5k

03Related

Versions, why it is listed, for AI to read

Recent releases

For AI agents

Data updated: AI software & hot ranks · Software profiles & needs · Official software downloads(UTC+8)