// Eval, observability & guardrails
ai-dynamo/aiperf
AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.
Official · NVIDIA DynamoApache-2.0Active
01Recent releases
-
ai-dynamo/aiperf v0.13.0 Minor
AIPerf — Release 0.13.0**
02Same category
All repos →
usestrix/strix Open-source AI penetration testing tool to find and fix your app’s vulnerabilities. Eval, observability & guardrails★ 70.8k 
langfuse/langfuse Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. Eval, observability & guardrails★ 36.2k 
vxcontrol/pentagi Fully autonomous AI Agents system capable of performing complex penetration testing tasks Eval, observability & guardrails★ 31.8k 
mlflow/mlflow The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applic… Eval, observability & guardrails★ 28.5k 
promptfoo/promptfoo Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative con… Eval, observability & guardrails★ 26.2k