10 agents tracked · Open-source-first, with limited public GitHub comparators · Ranked by trust score · Updated 2026-07-15 03:00 UTC
HVTracker independently evaluates 10 llm gateways & infra using daily signals from GitHub, package registries, and security databases. The category is open-source-first, with a limited set of public GitHub-hosted proprietary or source-available comparators when they are important ecosystem reference points. Each agent is scored on activity, adoption, transparency, safety, and identity. The top-ranked llm gateways & infra is Bifrost with a trust score of 88.2/100 (Grade A). Other leading projects include Headroom and vLLM.
| # | Agent | Trust | Stars | Language |
|---|---|---|---|---|
| 1 | Bifrost A Listed Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ mod | 88.2 | 6.5k | Go |
| 2 | Headroom A Listed Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library | 87.3 | 59.2k | Python |
| 3 | vLLM B Listed A high-throughput and memory-efficient inference and serving engine for LLMs | 79.8 | 86.3k | Python |
| 4 | LiteLLM B Listed Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails | 76.3 | 53.6k | Python |
| 5 | Jan B Listed Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. | 66.7 | 43.6k | TypeScript |
| 6 | Ollama B Listed Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. | 65.0 | 176.1k | Go |
| 7 | Instructor C Listed structured outputs for llms | 64.3 | 13.5k | Python |
| 8 | Portkey AI Gateway C Listed A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API | 51.1 | 12.4k | TypeScript |
| 9 | Chat Nio D Listed 🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Suppo | 37.8 | 9.2k | TypeScript |
| 10 | LocalAI D Listed LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU requir | 36.7 | 47.5k | Go |