updated 2026-07-15 01:30 UTC

Observability & Evaluation

21 agents tracked · Open-source-first, with limited public GitHub comparators · Ranked by trust score · Updated 2026-07-15 01:30 UTC

HVTracker independently evaluates 21 observability & evaluation using daily signals from GitHub, package registries, and security databases. The category is open-source-first, with a limited set of public GitHub-hosted proprietary or source-available comparators when they are important ecosystem reference points. Each agent is scored on activity, adoption, transparency, safety, and identity. The top-ranked observability & evaluation is MLflow with a trust score of 88.3/100 (Grade A). Other leading projects include Weights & Biases Weave and Arize Phoenix.

21
Agents
61
Avg Trust
199.9k
Total Stars
2
Grade A
# Agent Trust Stars Language
1 MLflow A Listed The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, eva 88.3 27.0k Python
2 Weights & Biases Weave A Listed Weave is a toolkit for developing AI-powered applications, built by Weights & Biases. 86.5 1.1k Python
3 Arize Phoenix B Listed AI Observability & Evaluation 77.6 10.6k Python
4 Promptfoo B Listed Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, C 74.2 23.3k TypeScript
5 LangWatch B Listed The platform for LLM evaluations and AI agent testing 72.7 3.4k TypeScript
6 Evidently B Listed Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or d 71.9 7.7k Jupyter Notebook
7 Langfuse B Listed 🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integ 70.7 31.2k TypeScript
8 Giskard B Listed 🐢 Open-Source Evaluation & Testing library for LLM Agents 69.5 5.5k Python
9 DeepEval B Listed The LLM Evaluation Framework 69.5 16.8k Python
10 Holmesgpt C Listed SRE Agent - CNCF Sandbox Project 62.6 2.9k Python
11 AgentOps C Listed Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frame 61.3 5.7k Python
12 Helicone C Listed 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓 60.5 5.9k TypeScript
13 OpenLIT C Listed Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations 59.9 2.6k TypeScript
14 Traceroot C Listed TraceRoot - open-source observability and self-healing layer for AI agents. YC S25 58.9 666 TypeScript
15 OpenLLMetry C Listed Open-source observability for your GenAI or LLM application, based on OpenTelemetry 55.1 7.3k Python
16 Ragas D Listed Supercharge Your LLM Application Evaluations 🚀 46.7 14.8k Python
17 Opik D Listed Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, autom 46.5 20.6k Python
18 Agenta D Listed The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one 43.7 4.3k TypeScript
19 TruLens D Listed Evaluation and Tracking for LLM Experiments and AI Agents 39.8 3.4k Python
20 AgentBench D Listed A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24) 36.2 3.6k Python
21 Webarena D Listed Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents" 35.4 1.5k Python