LLM Gateways & Infra
14 agents tracked · Open-source-first, with limited public GitHub comparators · Ranked by trust score · Updated 2026-08-29 04:33 UTC
HVTracker independently evaluates 14 llm gateways & infra using daily signals from GitHub, package registries, and security databases. The category is open-source-first, with a limited set of public GitHub-hosted proprietary or source-available comparators when they are important ecosystem reference points. Each agent is scored on activity, adoption, transparency, safety, and identity. The top-ranked llm gateways & infra is Bifrost with a trust score of 88.8/100 (Grade A). Other leading projects include Headroom and vLLM.
| # | Agent | Trust | Stars | Language |
|---|---|---|---|---|
| 1 | Bifrost A Listed Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ mod | 88.8 | 7.6k | Go |
| 2 | Headroom A Listed Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% | 86.7 | 67.9k | Python |
| 3 | vLLM A Listed A high-throughput and memory-efficient inference and serving engine for LLMs | 81.8 | 90.4k | Python |
| 4 | LiteLLM B Listed The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tra | 76.6 | 57.5k | Python |
| 5 | Ollama B Listed Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. | 67.8 | 179.7k | Go |
| 6 | Instructor B Listed structured outputs for llms | 67.6 | 13.8k | Python |
| 7 | Jan B Listed Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. | 65.9 | 44.2k | TypeScript |
| 8 | LLM Gateway C Listed Route, manage, and analyze your LLM requests across multiple providers with a unified API interface. | 63.2 | 1.6k | TypeScript |
| 9 | ClawRouter C Listed The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC paym | 59.3 | 6.6k | TypeScript |
| 10 | claude-code-router C Listed One local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay full | 58.3 | 37.0k | TypeScript |
| 11 | Portkey AI Gateway C Listed A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API | 55.3 | 12.8k | TypeScript |
| 12 | LocalAI D Listed LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU requir | 39.1 | 48.7k | Go |
| 13 | Chat Nio D Listed 🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Suppo | 38.4 | 9.3k | TypeScript |
| 14 | paritok-4b-v1 D Listed Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturate | 21.1 | 1.4k | Python |
Grade = trust band: A ≥ 80, B ≥ 65, C ≥ 50, D < 50 — methodology