LangWatch vs Promptfoo
Promptfoo leads on trust: 92.6/100 (Grade A) against 86.7/100 (Grade A), a 5.9-point gap. Promptfoo leads on supply-chain integrity and adoption.
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
LangWatch doesn't lead on any scored dimension in this pair.
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Choose Promptfoo if supply-chain integrity and adoption matter most.
- +4.2Safety / Integrity: 100% of recent commits signed, against 82%
- +3.4Adoption: 1.3M weekly downloads against 83.1k
- +2.2Transparency: OSSF Scorecard 7.5 against 4.9
Where they differ
2 dimensions identical: Identity 18.0 · Maintenance 20.0 · Full evidence table
An independent, evidence-based trust comparison of LangWatch and Promptfoo, two Observability & Evaluation projects in the HVTracker registry. Scores come from public, checkable signals — supply-chain provenance, OSSF Scorecard, maintenance, and adoption — not popularity.
Full evidence
| Signal | LangWatchlangwatch/langwatch | Promptfoopromptfoo/promptfoo |
|---|---|---|
| HVTrust score | 86.7 | 92.6 |
| Evidence grade | A | A |
| Coverage grade | A | A |
| Overall rank | #77 | #8 |
| Rank in Observability & Evaluation | #3 | #1 |
| GitHub stars | 5.0k | 26.8k |
| Last updated | today | today |
| Build provenance | Yes | Yes |
| OSSF Scorecard | 4.9 / 10 | 7.5 / 10 |
| License | Apache-2.0 | MIT |
| Downloads | 83k/wk | 1.3M/wk |
| Trust dimensions (points earned) | ||
| Safety / integrity / 25 | 17.7 | 21.9 |
| Identity & provenance / 18 | 18.0 | 18.0 |
| Transparency / 17 | 12.7 | 14.9 |
| Maintenance / 20 | 20.0 | 20.0 |
| Adoption / 20 | 15.4 | 18.8 |
| Runtime capability surface (full matrix) | ||
| MCP server | Implemented | Implemented |
| External providers | 1 — Anthropic | 3 — Amazon Bedrock, Anthropic, OpenAI |
| Requires API keys | No | Yes |
| Plugin surface | plugins | plugins |
| Provenance drift | Partial | Match |
How to read this: HVTrust (0–100) weighs supply-chain signals (provenance, OSSF Scorecard, signed commits, open license) alongside real-world adoption, scaled by an evidence-confidence factor. Grade bands: A ≥ 80, B ≥ 65, C ≥ 50, D < 50. Signals refresh daily. Full methodology v4.4 →