// Observability & tracing
Trace & monitor
Log LLM calls, traces, cost and quality.
37 tools36 open sourcechecked 2026-10-22Compare side by side →
How to choose · start with these three
37 / 37 items
langfuse v4.56.0 ★ 36k 🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. Open source SDKAPI opik 2.2.114-9133-merge-4061 ★ 23k Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. Open source SDKAPI phoenix arize-phoenix-v20.24.0 ★ 12k AI Observability & Evaluation Open source SDKAPI opensre ★ 12k Open-source toolkit to build AI SRE agents. Open source SDK datahub ★ 13k Context platform for your data and AI stack. Open source server agentsview ★ 6.1k Local-first session intelligence for coding agents. Open source local langwatch langwatch-3.21.0 ★ 5.0k Open-source agent observability and evals. Open source Web radar ★ 3.9k Open-source Kubernetes UI with a built-in MCP server for AI agents. Open source WebMCP latitude-llm ★ 4.7k Open-source observability for AI agents. Open source Web SwanLab ★ 4.3k Open-source AI training tracking and visualization. Open source Web netdata v2.12.1 ★ 81k The fastest path to AI-powered full stack observability, even for lean teams. Open source API grafana v13.2.3 ★ 77k The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more. Open source API prometheus v3.13.4 ★ 66k The Prometheus monitoring system and time series database. Open source API sentry 26.9.0 ★ 45k Developer-first error tracking and performance monitoring Open source API posthog agent-skills-v0.2862.0 ★ 40k :hedgehog: PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, flags, experiments, error tracking, logs, and more – capture all the context agents need to diagnose problems, uncover opportunities, and ship fixes. Steer it all from Slack, web, desktop, or the MCP. Open source API signoz v0.145.0 ★ 32k SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined with SigNoz MCP and a native AI teammate (in SigNoz Cloud) it helps you build more resilient apps. Open source API loki v0.12.0 ★ 29k Like Prometheus, but for logs. Open source API mlflow model-catalog%2Flatest ★ 28k The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data. Open source SDKAPI jaeger v2.22.0 ★ 23k CNCF Jaeger, a Distributed Tracing Platform Open source API vector v0.59.0 ★ 23k A high-performance observability data pipeline. Open source CLI openobserve v1.1.0-rc1 ★ 22k Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment. Open source API VictoriaMetrics v1.153.0 ★ 18k VictoriaMetrics: fast, cost-effective monitoring solution and time series database Open source API wandb v0.30.0 ★ 11k The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production. Open source SDK fluent-bit v5.0.11 ★ 8.1k Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows Open source CLI evidently v0.7.23 ★ 8.0k Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics. Open source SDK opentelemetry-collector v0.162.0 ★ 7.6k OpenTelemetry Collector Open source API openllmetry 0.62.4 ★ 7.5k Open-source observability for your GenAI or LLM application, based on OpenTelemetry Open source SDK helicone v2025.08.21-1 ★ 6.2k 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓 Open source API agentops 0.4.21 ★ 5.9k Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI Open source SDK tempo v3.1.0 ★ 5.5k Grafana Tempo is a high volume, minimal dependency distributed tracing backend. Open source API logfire v5.1.1 ★ 4.5k AI observability platform for production LLM and agent systems. Open source SDK lmnr v0.2.5 ★ 3.4k Laminar - open-source observability platform purpose-built for AI agents. YC S24. Open source SDK openlit openlit-2.1.1 ★ 2.8k OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL. Open source SDK opentelemetry-python v1.45.1 ★ 2.7k OpenTelemetry Python API and SDK Open source SDK parseable v3.2.5 ★ 2.5k Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression. Open source API weave v0.53.12 ★ 1.1k Weave is a toolkit for developing AI-powered applications, built by Weights & Biases. Open source SDK Datadog LLM Observability Closed / commercial
About this data
- Default order is “recommended”: editorial picks first, then by popularity; general-purpose developer software and archived projects are listed last.
- Data checked 2026-10-22. Official links only. JSON API