Registry › Compare › Evidently vs Promptfoo

Evidently vs Promptfoo

Promptfoo leads on trust: 92.2/100 (Grade A) against 77.9/100 (Grade B), a 14.3-point gap. Promptfoo leads on maintenance and supply-chain integrity.

B Evidently 77.9

Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

evidentlyai/evidently · #180 overall · #8 Observability & Evaluation · coverage A (4/5)

Evidently doesn't lead on any scored dimension in this pair.

A Promptfoo 92.2

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

promptfoo/promptfoo · #8 overall · #1 Observability & Evaluation · coverage A (4/5)

Choose Promptfoo if maintenance and supply-chain integrity matter most.

+7.1Maintenance: last push today, against 4d ago
+5.5Safety / Integrity: 100% of recent commits signed, against 89%
+3.4Transparency: OSSF Scorecard 7.4 against 3.4
+2.1Adoption: 905.4k weekly downloads against 204.9k

Where they differ

16.2

Safety / IntegrityPromptfoo +5.5

21.7

11.4

TransparencyPromptfoo +3.4

14.8

12.9

MaintenancePromptfoo +7.1

20.0

16.4

AdoptionPromptfoo +2.1

18.5

+3.0

Runtime calibrationEvidently +3.8

-0.8

1 dimension identical: Identity 18.0 · Full evidence table

An independent, evidence-based trust comparison of Evidently and Promptfoo, two Observability & Evaluation projects in the HVTracker registry. Scores come from public, checkable signals — supply-chain provenance, OSSF Scorecard, maintenance, and adoption — not popularity.

Full evidence

Signal	Evidentlyevidentlyai/evidently	Promptfoopromptfoo/promptfoo
HVTrust score	77.9	92.2
Evidence grade	B	A
Coverage grade	A	A
Overall rank	#180	#8
Rank in Observability & Evaluation	#8	#1
GitHub stars	8.0k	25.7k
Last updated	4d ago	today
Build provenance	Yes	Yes
OSSF Scorecard	3.4 / 10	7.4 / 10
License	Apache-2.0	MIT
Downloads	205k/wk	905k/wk
Trust dimensions (points earned)
Safety / integrity / 25	16.2	21.7
Identity & provenance / 18	18.0	18.0
Transparency / 17	11.4	14.8
Maintenance / 20	12.9	20.0
Adoption / 20	16.4	18.5
Runtime capability surface (full matrix)
MCP server	—	Implemented
External providers	3 — Multi-provider (LiteLLM), OpenAI, Postgres	3 — Amazon Bedrock, Anthropic, OpenAI
Requires API keys	No	Yes
Plugin surface	—	plugins
Provenance drift	Match	Match

Open in the live compare tool → Evidently profile Promptfoo profile More Observability & Evaluation →

How to read this: HVTrust (0–100) weighs supply-chain signals (provenance, OSSF Scorecard, signed commits, open license) alongside real-world adoption, scaled by an evidence-confidence factor. Grade bands: A ≥ 80, B ≥ 65, C ≥ 50, D < 50. Signals refresh daily. Full methodology v4.4 →