LLM Gateways & Infra
13 agents tracked · Open-source-first, with limited public GitHub comparators · Ranked by trust score · Updated 2026-08-14 15:32 UTC
HVTracker independently evaluates 13 llm gateways & infra using daily signals from GitHub, package registries, and security databases. The category is open-source-first, with a limited set of public GitHub-hosted proprietary or source-available comparators when they are important ecosystem reference points. Each agent is scored on activity, adoption, transparency, safety, and identity. The top-ranked llm gateways & infra is Bifrost with a trust score of 87.9/100 (Grade A). Other leading projects include Headroom and vLLM.
| # | Agent | Trust | Stars | Language |
|---|---|---|---|---|
| 1 | Bifrost A Listed Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ mod | 87.9 | 7.3k | Go |
| 2 | Headroom A Listed Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% | 87.0 | 66.3k | Python |
| 3 | vLLM A Listed A high-throughput and memory-efficient inference and serving engine for LLMs | 81.8 | 89.0k | Python |
| 4 | LiteLLM B Listed The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tra | 77.4 | 56.3k | Python |
| 5 | Ollama B Listed Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. | 67.4 | 178.5k | Go |
| 6 | Instructor B Listed structured outputs for llms | 66.1 | 13.7k | Python |
| 7 | Jan B Listed Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. | 65.0 | 44.0k | TypeScript |
| 8 | LLM Gateway C Listed Route, manage, and analyze your LLM requests across multiple providers with a unified API interface. | 63.2 | 1.5k | TypeScript |
| 9 | Portkey AI Gateway C Listed A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API | 57.2 | 12.7k | TypeScript |
| 10 | Chat Nio D Listed 🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Suppo | 39.4 | 9.3k | TypeScript |
| 11 | LocalAI D Listed LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU requir | 39.0 | 48.5k | Go |
| 12 | claude-code-router D Listed One local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay full | 25.3 | 36.6k | TypeScript |
| 13 | ClawRouter D Listed The agent-native LLM router for autonomous agents. 66 models (8 free), <1ms local routing, USDC payments on Base & Solan | 23.9 | 6.6k | TypeScript |
Grade = trust band: A ≥ 80, B ≥ 65, C ≥ 50, D < 50 — methodology