Registry › Compare › Promptfoo vs Weights & Biases Weave

Promptfoo vs Weights & Biases Weave

Promptfoo leads on trust: 92.9/100 (Grade A) against 83.8/100 (Grade A), a 9.1-point gap. Promptfoo leads on supply-chain integrity and adoption.

A Promptfoo 92.9

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

promptfoo/promptfoo · #8 overall · #1 Observability & Evaluation · coverage A (4/5)

Choose Promptfoo if supply-chain integrity and adoption matter most.

  • +4.0Adoption: 1.2M weekly downloads against 404.2k
  • +2.2Safety / Integrity: 100% of recent commits signed, against 84%
  • +1.7Maintenance: last push today, against 4d ago
  • +1.0Transparency: OSSF Scorecard 7.5 against 6.4

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.

wandb/weave · #118 overall · #5 Observability & Evaluation · coverage A (4/5)

Weights & Biases Weave doesn't lead on any scored dimension in this pair.

Where they differ

21.9
Safety / IntegrityPromptfoo +2.2
19.7
14.9
TransparencyPromptfoo +1.0
13.9
20.0
MaintenancePromptfoo +1.7
18.3
18.8
AdoptionPromptfoo +4.0
14.8
-0.7
Runtime calibrationPromptfoo +0.2
-0.9

1 dimension identical: Identity 18.0 · Full evidence table

An independent, evidence-based trust comparison of Promptfoo and Weights & Biases Weave, two Observability & Evaluation projects in the HVTracker registry. Scores come from public, checkable signals — supply-chain provenance, OSSF Scorecard, maintenance, and adoption — not popularity.

Full evidence

Signal Promptfoopromptfoo/promptfoo Weights & Biases Weavewandb/weave
HVTrust score 92.9 83.8
Evidence grade A A
Coverage grade A A
Overall rank #8 #118
Rank in Observability & Evaluation #1 #5
GitHub stars 27.4k 1.1k
Last updated today 4d ago
Build provenance Yes Yes
OSSF Scorecard 7.5 / 10 6.4 / 10
License MIT Apache-2.0
Downloads 1.2M/wk 404k/wk
Trust dimensions (points earned)
Safety / integrity / 25 21.9 19.7
Identity & provenance / 18 18.0 18.0
Transparency / 17 14.9 13.9
Maintenance / 20 20.0 18.3
Adoption / 20 18.8 14.8
Runtime capability surface (full matrix)
MCP server Implemented Implemented
External providers 3 — Amazon Bedrock, Anthropic, OpenAI 8 — Amazon Bedrock, Anthropic, Cohere, …
Requires API keys Yes Yes
Plugin surface plugins —
Provenance drift Match Partial
Open in the live compare tool → Promptfoo profile Weights & Biases Weave profile More Observability & Evaluation →

How to read this: HVTrust (0–100) weighs supply-chain signals (provenance, OSSF Scorecard, signed commits, open license) alongside real-world adoption, scaled by an evidence-confidence factor. Grade bands: A ≥ 80, B ≥ 65, C ≥ 50, D < 50. Signals refresh daily. Full methodology v4.4 →