Agent Laboratory

Agent Laboratory is an end-to-end autonomous research workflow meant to assist you as the human researcher toward implementing your research ideas

Research & Data Python Needs review MIT

Is Agent Laboratory safe? Thin or incomplete trust evidence. Review carefully before production use.

OSSF Scorecard 1.8 / 10
Provenance None
Signed commits 39%
Last push 415d ago
Compare Agent Laboratory
Suggest a correction

In detail: Agent Laboratory scores 23.0/100 (Grade D), ranked #1359 of 1371 tracked open-source AI agent projects, on evidence coverage B (3 of 5 independent signal types). The public evidence: no package-provenance attestation found; OSSF Scorecard rates its supply-chain practices 1.8/10; 39% of recent commits are signed; last pushed 2025-08-20. Every point is earned from checkable signals — never paid placement. How scoring works →

How Agent Laboratory could raise its score

Each line changes one public signal and recomputes with the live scoring function. The gains don't add up exactly, because the score is capped near the top.

Active listing, but review is needed
  • [4.2.1] no meaningful activity in 12 months (last push 2025-08-20)

Chain of custody

Scanners check what the code says. This traces who ships Agent Laboratory and whether that has changed: from the source repository, through how changes are reviewed and released, to the code you run. These are the checks for OWASP ASI04 Agentic Supply Chain Vulnerabilities.

  1. Source Partly signed

    github.com/SamuelSchmidgall/AgentLaboratory, MIT, last pushed 2025-08-20. 39% of the last 100 commits carry a verified signature; the rest can't be tied to a verified identity.

  2. Review and release Weak

    OpenSSF Scorecard rates the repository's practices 1.8/10 (scanned Jul 11, 2026, refresh pending). The checks that decide who can get a change released:

    • Code Review2
    • Branch Protection0
    • Signed Releasesn/a
    • Dangerous Workflown/a
    • Token Permissionsn/a
    • Pinned Dependenciesn/a
    All 18 Scorecard checks
    Binary-Artifacts 10
    Branch-Protection 0
    CI-Tests 0
    CII-Best-Practices 0
    Code-Review 2
    Contributors 3
    Dangerous-Workflow -1
    Dependency-Update-Tool 0
    Fuzzing 0
    License 10
    Maintained 0
    Packaging -1
    Pinned-Dependencies -1
    SAST 0
    Security-Policy 0
    Signed-Releases -1
    Token-Permissions -1
    Vulnerabilities 0
  3. Published packages None

    No registry package. Agent Laboratory is used from its repository, so what you run is whatever you check out: pin a release tag or commit.

Changes to this chain

No change to package provenance, package source links, Scorecard coverage or license in HVTracker's daily snapshots of Agent Laboratory.

Evidence behind this score

Coverage B: 3 of 5 independent evidence types found.

  • GitHub repository data
  • Package downloads (missing)
  • Supply-chain checks
  • Public actions (missing)
  • Community mentions

Verify this score yourself

Every build re-issues Agent Laboratory’s score as an Ed25519-signed credential, valid for 7 days. You can check it offline against HVTracker’s published key; if anyone changes a number after signing, verification fails.

What this score doesn’t check

It covers who ships the code, not what the code does. It doesn’t read tool descriptions or prompts for injected instructions, watch runtime behaviour, or find bugs nobody has disclosed yet. For that, run a content scanner before you connect it, such as Cisco MCP Scanner or Snyk Agent Scan.

How Agent Laboratory compares in Research & Data

  1. #31 MindSearch 27.5 +4.5
  2. #32 SoL-Pi 23.3 +0.3
  3. #33 Agent Laboratory 23.0 this agent
  4. #34 DeepAnalyze 21.8 −1.2
  5. #35 Comp AI CRM 19.6 −3.4

Bars show each HVTrust score; the tick marks Agent Laboratory’s 23.0.

Where the 23.0 comes from

HVTrust dimensions vs the Research & Data average

23.0 / 100 · 100.0% confidence

Agent Laboratory Research & Data average (37 agents)

Safety / Integrity50% OSSF Scorecard · 30% provenance · 20% signed commits
4.2 / 25
4.0 below avg 8.2
Identity / Provenance60% listing status · 40% build provenance
10.8 / 18
1.2 below avg 12.0
Transparency50% declared license · 50% OSSF Scorecard
10.0 / 17
1.5 below avg 11.5
Maintenance60% last-push freshness · 40% commit activity
0 / 20
13.2 below avg 13.2
AdoptionLog-scaled stars · package downloads
9.0 / 20
1.9 below avg 10.9

Quick Trust Read

What Would Improve It
Publish package provenance or release attestations for stronger supply-chain evidence.
Recent Changes
2026-10-09
Rank Moved
Rank dropped 21 spots (#1338 → #1359)
2026-09-23
Rank Moved
Rank dropped 245 spots (#1070 → #1315)
2026-09-22
Rank Moved
Rank dropped 636 spots (#434 → #1070)
Maintainer Checklist
Raise Scorecard signals Current OSSF Scorecard is 1.8/10. Tighten the weakest checks to improve public safety evidence.
Publish provenance Add package provenance or release attestations so users can verify where shipped artifacts came from.
Increase signed commits Raise the share of verified-signed commits to make maintainer identity and release history easier to trust.
Refresh maintenance signals The repo was last pushed 415 days ago. Fresh activity helps separate stable projects from stale ones.
Review Flags
[4.2.1] no meaningful activity in 12 months (last push 2025-08-20)
36.1
Activity sub-score · out of 100
#33

How to read this: HVTrust (0–100) weighs supply-chain signals (provenance, OSSF Scorecard, signed commits, open license) alongside real-world adoption. Grade D reflects the trust score band: A ≥ 80, B ≥ 65, C ≥ 50, D < 50. Evidence coverage B is separate — it grades how many independent signal types back the score (3 of 5), so a high score on thin evidence stays visible. Full methodology →

Signals refreshed 2026-10-09 16:07 UTC · Repo last pushed 415 days ago — may be stale

Rank Trend

2026-09-29 2026-10-09

Activity & Reach

Stars
5.9k
Forks
804
Last Push
2025-08-20
415 days ago
Commits (4 wk)
0
Downloads (7d)
—
HN mentions (30d)
0
Open Issues
39
Rank Change
▼21
was #1338

Analysis

Activity Inputs

36.1 / 100
StarsRepository reach
22.6 / 30
FreshnessLast push recency
0.0 / 25
ActivityRecent commits
0.0 / 25
CommunityFork signal
13.5 / 20

Common questions about Agent Laboratory

Public trust evidence for Agent Laboratory is thin: several supply-chain signals are missing or weak. This does not mean the project is unsafe — it means an outside observer cannot easily verify the usual integrity checks. Treat with extra scrutiny.
Does Agent Laboratory publish package provenance?
No published build provenance is currently detected for Agent Laboratory. This is common for open-source projects but means consumers cannot independently verify that the package on the registry matches the GitHub source.
Does Agent Laboratory have an OpenSSF Scorecard?
Agent Laboratory has an OpenSSF Scorecard score of 1.8/10. The Scorecard checks for branch protection, signed releases, dependency updates, fuzzing, code review, and other supply-chain hygiene items. See the full check breakdown on this page.
Is Agent Laboratory actively maintained?
Stale. The repository has not been pushed to in 415 days. Consider whether the project is still being maintained.
What license does Agent Laboratory use?
Agent Laboratory ships under MIT. A declared, OSI-approved license is one of the transparency signals HVTrust scores.
Are Agent Laboratory's commits signed?
38% of the last 100 commits to Agent Laboratory are verified-signed (GPG, SSH, S/MIME, or GitHub's signing flow). Signed commits help confirm that code was authored by who the commit claims.

Not a safety endorsement. HVTracker describes what public signals show, not whether a project is safe for your use case. Run your own security review before adopting in production.

AI agent surface

MCP, providers, tool surface
Scored in HVTrust

These runtime-trust fields — detected from public repo docs and manifests — contribute a bounded adjustment to this project's HVTrust score alongside supply-chain evidence. The exact values each field can add or subtract are documented in the methodology → Compare this surface across every listed agent in the capability matrix →

MCP Server Support
None detected
No MCP server signal detected.
Detailed evidence is not shown in the public view.
External Service Dependencies
high confidence
3 detected
Public provider/service dependencies detected.
Credential signal: No explicit API-key/config marker detected.
Tool / Plugin Surface
None detected
No clear plugin system or broad tool surface detected.
Detailed evidence is not shown in the public view.
Package Provenance Drift
N/A
No package source configured
Detailed evidence is not shown in the public view.
  • MCP signal live
  • External deps live
  • Tool / plugin surface live
  • Package provenance drift live

Maintain Agent Laboratory?

For maintainers

HVTrust scores Agent Laboratory from public signals only — we never contact maintainers first. If a signal is wrong, stale, or missing (provenance you publish, a Scorecard you run, signed releases), tell us and we'll review it. Corrections are public and tracked on GitHub.

Reputation Timeline

Signal history
Rank 22Warning Issued 1HVTrust 1
2026-10-09
Rank Moved
Rank dropped 21 spots (#1338 → #1359)
2026-09-23
Rank Moved
Rank dropped 245 spots (#1070 → #1315)
2026-09-22
Rank Moved
Rank dropped 636 spots (#434 → #1070)
2026-09-21
Rank Moved
Rank rose 881 spots (#1315 → #434)
2026-09-05
Rank Moved
Rank dropped 12 spots (#1280 → #1292)
2026-09-04
Rank Moved
Rank dropped 12 spots (#1268 → #1280)
2026-09-02
Rank Moved
Rank dropped 26 spots (#1234 → #1260)
2026-09-01
Rank Moved
Rank dropped 22 spots (#1212 → #1234)
2026-08-31
Rank Moved
Rank dropped 24 spots (#1188 → #1212)
2026-08-30
Rank Moved
Rank dropped 26 spots (#1162 → #1188)
2026-08-29
Rank Moved
Rank dropped 29 spots (#1133 → #1162)
2026-08-28
Rank Moved
Rank dropped 21 spots (#1112 → #1133)
2026-08-27
Rank Moved
Rank dropped 17 spots (#1095 → #1112)
2026-08-26
Rank Moved
Rank dropped 70 spots (#1025 → #1095)
2026-08-21
Rank Moved
Rank dropped 258 spots (#768 → #1026)
2026-08-21
HVTrust Changed
HVTrust down 10.0pts (31.0 → 21.0)
2026-08-20
Warning Issued
Warning: eligibility issues detected
2026-08-16
Rank Moved
Rank dropped 15 spots (#752 → #767)
2026-08-10
Rank Moved
Rank dropped 40 spots (#716 → #756)
2026-08-08
Rank Moved
Rank dropped 294 spots (#420 → #714)
2026-07-29
Rank Moved
Rank dropped 12 spots (#399 → #411)
2026-07-15
Rank Moved
Rank dropped 23 spots (#371 → #394)
2026-07-14
Rank Moved
Rank dropped 21 spots (#350 → #371)
2026-07-13
Rank Moved
Rank dropped 36 spots (#314 → #350)

Embed Badge Badge guide for maintainers →

For maintainers
HVTrust 23.0 Grade D
Markdown:
[![HVTrust](https://hvtracker.net/badge/agent-laboratory.svg)](https://hvtracker.net/agents/agent-laboratory)
HTML:
<a href="https://hvtracker.net/agents/agent-laboratory"><img src="https://hvtracker.net/badge/agent-laboratory.svg" alt="HVTrust"></a>

Other agents in Research & Data

Data sources
GitHub REST API (repo, commits, stars, forks, license) · OpenSSF Scorecard CLI · Algolia HN Search API
Each agent's signals refresh once daily across 6 staggered batches. Methodology v4.4 · Raw JSON