SoL-Pi

SoL-Pi: Scaling Auto-Research Loops for Efficient Agent Harnesses

Research & Data TypeScript Listed MIT

Is SoL-Pi safe? Thin or incomplete trust evidence. Review carefully before production use.

OSSF Scorecard No result
Provenance None
Signed commits 25%
Last push today
Compare SoL-Pi
Suggest a correction

In detail: SoL-Pi scores 23.6/100 (Grade D), ranked #1366 of 1378 tracked open-source AI agent projects, on evidence coverage D (1 of 5 independent signal types). The public evidence: no package-provenance attestation found; no OSSF Scorecard result yet; 25% of recent commits are signed; last pushed 2026-10-16. Every point is earned from checkable signals — never paid placement. How scoring works →

How SoL-Pi could raise its score

Each line changes one public signal and recomputes with the live scoring function. The gains don't add up exactly, because the score is capped near the top.

Chain of custody

Scanners check what the code says. This traces who ships SoL-Pi and whether that has changed: from the source repository, through how changes are reviewed and released, to the code you run. These are the checks for OWASP ASI04 Agentic Supply Chain Vulnerabilities.

  1. Source Partly signed

    github.com/NVlabs/SoL-Pi, MIT, last pushed 2026-10-16. 25% of the last 100 commits carry a verified signature; the rest can't be tied to a verified identity.

  2. Review and release Not checked

    No OpenSSF Scorecard result yet, so branch protection, code review and release signing are unverified.

  3. Published packages None

    No registry package. SoL-Pi is used from its repository, so what you run is whatever you check out: pin a release tag or commit.

Changes to this chain

No change to package provenance, package source links, Scorecard coverage or license in HVTracker's daily snapshots of SoL-Pi.

Evidence behind this score

Coverage D: 1 of 5 independent evidence types found.

  • GitHub repository data
  • Package downloads (missing)
  • Supply-chain checks (missing)
  • Public actions (missing)
  • Community mentions (missing)

Verify this score yourself

Every build re-issues SoL-Pi’s score as an Ed25519-signed credential, valid for 7 days. You can check it offline against HVTracker’s published key; if anyone changes a number after signing, verification fails.

What this score doesn’t check

It covers who ships the code, not what the code does. It doesn’t read tool descriptions or prompts for injected instructions, watch runtime behaviour, or find bugs nobody has disclosed yet. For that, run a content scanner before you connect it, such as Cisco MCP Scanner or Snyk Agent Scan.

How SoL-Pi compares in Research & Data

  1. #32 MindSearch 27.5 +3.9
  2. #33 Open Science Desktop 23.7 +0.1
  3. #34 SoL-Pi 23.6 this agent
  4. #35 Agent Laboratory 23.1 −0.5
  5. #36 DeepAnalyze 22.3 −1.3

Bars show each HVTrust score; the tick marks SoL-Pi’s 23.6.

Where the 23.6 comes from

HVTrust dimensions vs the Research & Data average

23.6 / 100 · 50.0% confidence

SoL-Pi Research & Data average (38 agents)

Safety / Integrity50% OSSF Scorecard · 30% provenance · 20% signed commits
1.3 / 25
7.0 below avg 8.3
Identity / Provenance60% listing status · 40% build provenance
10.8 / 18
1.1 below avg 11.9
Transparency50% declared license · 50% OSSF Scorecard
8.5 / 17
3.2 below avg 11.7
Maintenance60% last-push freshness · 40% commit activity
18.6 / 20
5.2 above avg 13.4
AdoptionLog-scaled stars · package downloads
8.5 / 20
2.3 below avg 10.8

Quick Trust Read

What Would Improve It
Add or improve OSSF Scorecard coverage so safety checks are easier to verify.
Recent Changes
2026-10-14
Tool Surface Changed
Detected tool/plugin surface changed: extension-based → declared
2026-10-14
Provider Added
Runtime surface grew — new detected provider dependency: Anthropic
2026-10-09
Rank Moved
Rank dropped 21 spots (#1335 → #1356)
Maintainer Checklist
Add Scorecard coverage Expose the repository to OpenSSF Scorecard checks so supply-chain posture is easier to verify.
Publish provenance Add package provenance or release attestations so users can verify where shipped artifacts came from.
Increase signed commits Raise the share of verified-signed commits to make maintainer identity and release history easier to trust.
78.4
Activity sub-score · out of 100
#34

How to read this: HVTrust (0–100) weighs supply-chain signals (provenance, OSSF Scorecard, signed commits, open license) alongside real-world adoption. Grade D reflects the trust score band: A ≥ 80, B ≥ 65, C ≥ 50, D < 50. Evidence coverage D is separate — it grades how many independent signal types back the score (1 of 5), so a high score on thin evidence stays visible. Full methodology →

Signals refreshed 2026-10-16 16:07 UTC · Repo last pushed today

Rank Trend

2026-09-29 2026-10-16

Activity & Reach

Stars
3.5k
Forks
280
Last Push
2026-10-16
today
Commits (4 wk)
45
Downloads (7d)
—
HN mentions (30d)
—
Open Issues
28
Rank Change
▼2
was #1364

Analysis

Activity Inputs

78.4 / 100
StarsRepository reach
21.3 / 30
FreshnessLast push recency
25.0 / 25
ActivityRecent commits
20.7 / 25
CommunityFork signal
11.4 / 20

Common questions about SoL-Pi

Public trust evidence for SoL-Pi is thin: several supply-chain signals are missing or weak. This does not mean the project is unsafe — it means an outside observer cannot easily verify the usual integrity checks. Treat with extra scrutiny.
Does SoL-Pi publish package provenance?
No published build provenance is currently detected for SoL-Pi. This is common for open-source projects but means consumers cannot independently verify that the package on the registry matches the GitHub source.
Does SoL-Pi have an OpenSSF Scorecard?
No OpenSSF Scorecard data is currently published for SoL-Pi. Maintainers can enable the Scorecard GitHub Action to get a public score; without it, automated supply-chain hygiene is harder for outsiders to verify.
Is SoL-Pi actively maintained?
Actively maintained. The repository was pushed to within the last 1 day(s).
What license does SoL-Pi use?
SoL-Pi ships under MIT. A declared, OSI-approved license is one of the transparency signals HVTrust scores.
Are SoL-Pi's commits signed?
25% of the last 100 commits to SoL-Pi are verified-signed (GPG, SSH, S/MIME, or GitHub's signing flow). Signed commits help confirm that code was authored by who the commit claims.

Not a safety endorsement. HVTracker describes what public signals show, not whether a project is safe for your use case. Run your own security review before adopting in production.

AI agent surface

MCP, providers, tool surface
Scored in HVTrust

These runtime-trust fields — detected from public repo docs and manifests — contribute a bounded adjustment to this project's HVTrust score alongside supply-chain evidence. The exact values each field can add or subtract are documented in the methodology → Compare this surface across every listed agent in the capability matrix →

MCP Server Support
None detected
No MCP server signal detected.
Detailed evidence is not shown in the public view.
External Service Dependencies
medium confidence
1 detected
Public provider/service dependencies detected.
Credential signal: No explicit API-key/config marker detected.
Tool / Plugin Surface
high confidence
Declared
Declared plugin/integration surface detected.
Detailed evidence is not shown in the public view.
Package Provenance Drift
N/A
No package source configured
Detailed evidence is not shown in the public view.
  • MCP signal live
  • External deps live
  • Tool / plugin surface live
  • Package provenance drift live
How this surface has changed

Detected changes to SoL-Pi's runtime surface and supply-chain posture, from daily public-signal snapshots. A change here means our detectors see something different — a genuinely changed capability, or better evidence of an existing one.

2026-10-14
Tool Surface Changed
Detected tool/plugin surface changed: extension-based → declared
2026-10-14
Provider Added
Runtime surface grew — new detected provider dependency: Anthropic

Maintain SoL-Pi?

For maintainers

HVTrust scores SoL-Pi from public signals only — we never contact maintainers first. If a signal is wrong, stale, or missing (provenance you publish, a Scorecard you run, signed releases), tell us and we'll review it. Corrections are public and tracked on GitHub.

Reputation Timeline

Signal history
Listed 1Rank 1Surface 1Surface 1
2026-10-14
Tool Surface Changed
Detected tool/plugin surface changed: extension-based → declared
2026-10-14
Provider Added
Runtime surface grew — new detected provider dependency: Anthropic
2026-10-09
Rank Moved
Rank dropped 21 spots (#1335 → #1356)
2026-09-29
Newly Listed
First tracked at rank #1332

Embed Badge Badge guide for maintainers →

For maintainers
HVTrust 23.6 Grade D
Markdown:
[![HVTrust](https://hvtracker.net/badge/sol-pi.svg)](https://hvtracker.net/agents/sol-pi)
HTML:
<a href="https://hvtracker.net/agents/sol-pi"><img src="https://hvtracker.net/badge/sol-pi.svg" alt="HVTrust"></a>

Other agents in Research & Data

Data sources
GitHub REST API (repo, commits, stars, forks, license)
Each agent's signals refresh once daily across 6 staggered batches. Methodology v4.4 · Raw JSON