Arize Phoenix vs Promptfoo
An independent, evidence-based trust comparison of Arize Phoenix and Promptfoo, two Observability & Evaluation projects in the HVTracker registry. Scores come from public, checkable signals — supply-chain provenance, OSSF Scorecard, maintenance, and adoption — not popularity.
Promptfoo leads on trust — 92.2/100 (Grade A) vs 74.5/100 (Grade B), a 17.7-point gap. Full breakdown below.
| Signal | Arize PhoenixArize-AI/phoenix | Promptfoopromptfoo/promptfoo |
|---|---|---|
| HVTrust score | 74.5 | 92.2 |
| Evidence grade | B | A |
| Coverage grade | A | A |
| Overall rank | #238 | #5 |
| Rank in Observability & Evaluation | #9 | #1 |
| GitHub stars | 11.5k | 25.3k |
| Last updated | today | today |
| Build provenance | Yes | Yes |
| OSSF Scorecard | — | 7.4 / 10 |
| License | NOASSERTION | MIT |
| Downloads | 160k/wk | 560k/wk |
| Trust dimensions (points earned) | ||
| Safety / integrity / 25 | 10.1 | 21.7 |
| Identity & provenance / 18 | 18.0 | 18.0 |
| Transparency / 17 | 8.5 | 14.8 |
| Maintenance / 20 | 20.0 | 20.0 |
| Adoption / 20 | 16.7 | 18.2 |
| Runtime capability surface (full matrix) | ||
| MCP server | Implemented | Implemented |
| External providers | 6 — Amazon Bedrock, Anthropic, E2B, … | 2 — Anthropic, OpenAI |
| Requires API keys | No | Yes |
| Plugin surface | plugins | plugins |
| Provenance drift | Partial | Match |
Open in the live compare tool →
Arize Phoenix profile
Promptfoo profile
More Observability & Evaluation →
How to read this: HVTrust (0–100) weighs supply-chain signals (provenance, OSSF Scorecard, signed commits, open license) alongside real-world adoption, scaled by an evidence-confidence factor. Grade bands: A ≥ 80, B ≥ 65, C ≥ 50, D < 50. Signals refresh daily. Full methodology v4.3 →