// Evaluate & guard
deepevalv4.1.5
The LLM Evaluation Framework
Open source Maintained For developers
IN ONE PARAGRAPH
deepeval is the LLM Evaluation Framework.
Good for: Developers and teams who want to evaluate & guard.
01How to start
- 1Read the official quick-start (link above).
- 2Install from the official package registry:
npm install deepevalpip install deepeval - 3Try it on a small example before wiring it into a project.
02Alternatives & comparison
Compare side by side → promptfoo Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic. ★ 26k lighteval Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends ★ 2.6k lm-evaluation-harness A framework for few-shot evaluation of language models. ★ 14k giskard-oss 🐢 Open-Source Evaluation & Testing library for LLM Agents ★ 5.9k trulens Evaluation and Tracking for LLM Experiments and AI Agents ★ 3.6k