Registry › Compare › Arize Phoenix vs Promptfoo

Arize Phoenix vs Promptfoo

Promptfoo leads on trust: 92.6/100 (Grade A) against 75.1/100 (Grade B), a 17.5-point gap. Promptfoo leads on supply-chain integrity and transparency.

B Arize Phoenix 75.1

AI Observability & Evaluation

Arize-AI/phoenix · #261 overall · #9 Observability & Evaluation · coverage A (4/5)

Arize Phoenix doesn't lead on any scored dimension in this pair.

A Promptfoo 92.6

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

promptfoo/promptfoo · #8 overall · #1 Observability & Evaluation · coverage A (4/5)

Choose Promptfoo if supply-chain integrity and transparency matter most.

+11.2Safety / Integrity: 100% of recent commits signed, against 63%
+6.4Transparency
+2.1Adoption: 1.3M weekly downloads against 158.2k

Where they differ

10.7

Safety / IntegrityPromptfoo +11.2

21.9

8.5

TransparencyPromptfoo +6.4

14.9

20.0

MaintenanceArize Phoenix +0.1

19.9

16.7

AdoptionPromptfoo +2.1

18.8

+1.2

Runtime calibrationArize Phoenix +2.1

-0.9

1 dimension identical: Identity 18.0 · Full evidence table

An independent, evidence-based trust comparison of Arize Phoenix and Promptfoo, two Observability & Evaluation projects in the HVTracker registry. Scores come from public, checkable signals — supply-chain provenance, OSSF Scorecard, maintenance, and adoption — not popularity.

Full evidence

Signal	Arize PhoenixArize-AI/phoenix	Promptfoopromptfoo/promptfoo
HVTrust score	75.1	92.6
Evidence grade	B	A
Coverage grade	A	A
Overall rank	#261	#8
Rank in Observability & Evaluation	#9	#1
GitHub stars	12.1k	26.8k
Last updated	today	1d ago
Build provenance	Yes	Yes
OSSF Scorecard	—	7.5 / 10
License	NOASSERTION	MIT
Downloads	158k/wk	1.3M/wk
Trust dimensions (points earned)
Safety / integrity / 25	10.7	21.9
Identity & provenance / 18	18.0	18.0
Transparency / 17	8.5	14.9
Maintenance / 20	20.0	19.9
Adoption / 20	16.7	18.8
Runtime capability surface (full matrix)
MCP server	Implemented	Implemented
External providers	6 — Amazon Bedrock, Anthropic, E2B, …	3 — Amazon Bedrock, Anthropic, OpenAI
Requires API keys	No	Yes
Plugin surface	plugins	plugins
Provenance drift	Partial	Match

Open in the live compare tool → Arize Phoenix profile Promptfoo profile More Observability & Evaluation →

How to read this: HVTrust (0–100) weighs supply-chain signals (provenance, OSSF Scorecard, signed commits, open license) alongside real-world adoption, scaled by an evidence-confidence factor. Grade bands: A ≥ 80, B ≥ 65, C ≥ 50, D < 50. Signals refresh daily. Full methodology v4.4 →