// Eval, observability & guardrails
vxcontrol/pentagi
Fully autonomous AI Agents system capable of performing complex penetration testing tasks
MITActive
01Recent releases
-
vxcontrol/pentagi v2.2.0 Minor
PentAGI 2.2 — Any Modern LLM, a Contained Sandbox, Unified Web Search, and Multi-Instance Deployment**
02Same category
All repos →
usestrix/strix Open-source AI penetration testing tool to find and fix your app’s vulnerabilities. Eval, observability & guardrails★ 70.8k 
langfuse/langfuse Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. Eval, observability & guardrails★ 36.2k 
mlflow/mlflow The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applic… Eval, observability & guardrails★ 28.5k 
promptfoo/promptfoo Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative con… Eval, observability & guardrails★ 26.2k 
comet-ml/opik Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. Eval, observability & guardrails★ 22.8k