// Evaluation, red-teaming & guardrails
Evaluate & guard
Evaluation, regression tests, red-teaming and guardrails for models and agents.
36 tools34 open sourcechecked 2026-10-22Compare side by side →
How to choose · start with these three
36 / 36 items
promptfoo 0.124.1 ★ 26k Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic. Open source CLI deepeval v4.1.5 ★ 19k The LLM Evaluation Framework Open source SDK ragas v0.4.3 ★ 16k Supercharge Your LLM Application Evaluations 🚀 Open source SDK iFixAi v4.2.1 ★ 32k Independent auditing of AI agents: what they did and whether it was safe. Open source CLI e2e ★ 11k Next-generation e2e testing framework for web and mobile. Open source SDK evalscope ★ 3.6k Streamlined framework for evaluating LLMs, VLMs and AIGC models. Open source Python deepteam ★ 3.0k Framework to red-team LLMs and AI agents. Open source Python FastChat v0.2.36 ★ 40k An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena. Open source CLIAPI openai/evals 3.0.1 ★ 20k Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks. Open source CLI lm-evaluation-harness v0.4.13 ★ 14k A framework for few-shot evaluation of language models. Open source CLI gorilla v1.3 ★ 13k Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls) Open source CLI opencompass 0.5.4 ★ 7.5k OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety. Open source CLI SWE-bench v5.0.1 ★ 6.1k SWE-bench: Can Language Models Resolve Real-world Github Issues? Open source CLI giskard-oss v1.0.6 ★ 5.9k 🐢 Open-Source Evaluation & Testing library for LLM Agents Open source SDK agenta v0.122.10 ★ 4.8k Agenta is a workspace where you and your team build agents and automations. Open source API simple-evals ★ 4.7k Open source CLI lmms-eval v0.7.3 ★ 4.5k One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks Open source CLI VLMEvalKit v0.2 ★ 4.5k Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks Open source CLI AgentBench ★ 3.8k A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24) Open source CLI trulens trulens-2.15.0 ★ 3.6k Evaluation and Tracking for LLM Experiments and AI Agents Open source SDK OSWorld v0.1.16 ★ 3.2k [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments Open source CLI inspect_ai 0.3.283 ★ 3.1k Inspect: A framework for large language model evaluations Open source CLISDK helm v0.5.16 ★ 2.9k Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models. Open source CLI terminal-bench-1 ★ 2.6k A benchmark for LLMs on complicated tasks in the terminal Open source CLI lighteval v0.13.0 ★ 2.6k Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends Open source CLI evaluate v0.4.6 ★ 2.5k 🤗 Evaluate: A library for easily evaluating machine learning models and datasets. Open source SDK tau2-bench v1.0.1 ★ 2.2k τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains Open source CLI mle-bench ★ 1.8k MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering Open source CLI webarena v0.2.0 ★ 1.6k Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents" Open source CLI tau-bench ★ 1.5k Code and Data for Tau-Bench Open source CLI BrowserGym v0.14.3 ★ 1.4k 🌎💪 BrowserGym, a Gym environment for web task automation Open source SDK LiveBench ★ 1.3k LiveBench: A Challenging, Contamination-Free LLM Benchmark Open source CLI openevals openevals==0.2.2 ★ 1.2k Readymade evaluators for your LLM apps Open source SDK autoevals py-0.4.0 ★ 1.0k AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices. Open source SDK Braintrust Closed / commercial LangSmith Closed / commercial
About this data
- Default order is “recommended”: editorial picks first, then by popularity; general-purpose developer software and archived projects are listed last.
- Data checked 2026-10-22. Official links only. JSON API