2,002 offers
Free Gateways & Routers — open-source & self-hostable
Self-hostable LLM proxies, routers, gateways
Scores rate free-tier value on a 1–10 scale. How scores work →
-
LiteLLM Gateways & Routers 8.1 Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] 52.5k★3.5k/90d14 devs/90d -
SGLang Router Gateways & Routers 8.1 SGLang is a high-performance serving framework for large language models and multimodal models. 29.9k★3.5k/90d57 devs/90d -
New API Gateways & Routers 7.9 A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management. 🍥 41k★500/90d17 devs/90d -
Apache APISIX Gateways & Routers 7.3 The Cloud-Native API Gateway and AI Gateway 16.8k★287/90d8 devs/90d -
Bifrost Gateways & Routers 7.2 Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS. 6.3k★1.8k/90d17 devs/90d -
Higress AI Gateway Gateways & Routers 7.0 🤖 AI Gateway | AI Native API Gateway 8.8k★95/90d23 devs/90d -
Kong Gateway Gateways & Routers 6.9 🦍 The API and AI Gateway 43.7k★11/90d4 devs/90d -
aisuite Gateways & Routers 6.9 Simple, unified interface to multiple Generative AI providers 14.9k★88/90d8 devs/90d -
kgateway Gateways & Routers 6.9 The Cloud-Native API Gateway and AI Gateway 5.6k★222/90d18 devs/90d -
agentgateway Gateways & Routers 6.9 Next Generation Agentic Proxy for AI Agents and MCP servers 3.7k★564/90d34 devs/90d -
vLLM Semantic Router Gateways & Routers 6.8 System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge 4.8k★381/90d21 devs/90d -
MCP Context Forge Gateways & Routers 6.8 An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins. 4k★404/90d21 devs/90d -
LLM (Datasette) Gateways & Routers 6.7 Access large language models from the command-line 12.1k★97/90d7 devs/90d -
TensorZero Gateways & Routers 6.7 TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation. 11.7k★190/90d11 devs/90d -
Envoy AI Gateway Gateways & Routers 6.4 Manages Unified Access to Generative AI Services built on Envoy Gateway 1.8k★148/90d33 devs/90d -
Arch Gateway Gateways & Routers 6.3 Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic. 6.6k★53/90d7 devs/90d -
LLM Gateway (theopenco) Gateways & Routers 6.3 Route, manage, and analyze your LLM requests across multiple providers with a unified API interface. 1.4k★898/90d5 devs/90d -
MetaMCP Gateways & Routers 6.1 MCP Aggregator, Orchestrator, Middleware, Gateway in one docker 2.5k★70/90d10 devs/90d -
any-llm Gateways & Routers 6.0 Communicate with an LLM provider using a single interface 2.1k★89/90d20 devs/90d -
Docker MCP Gateway Gateways & Routers 6.0 docker mcp CLI plugin / MCP Gateway 1.5k★124/90d9 devs/90d -
Portkey AI Gateway Gateways & Routers 5.8 A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. 12.3k★8/90d3 devs/90d -
OptiLLM Gateways & Routers 5.7 Optimizing inference proxy for LLMs 4.2k★7/90d3 devs/90d -
Semantic Router Gateways & Routers 5.6 Superfast AI decision making and intelligent processing of multi-modal data. 3.7k★25/90d3 devs/90d -
OpenLLM Gateways & Routers 5.5 Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud. 12.4k★1/90d1 devs/90d -
One API Gateways & Routers 5.4 LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI. 35.5k★0/90d0 devs/90d -
MCPJungle Gateways & Routers 5.2 One place to manage & connect to all your MCP servers 1.1k★39/90d7 devs/90d -
LangDB AI Gateway Gateways & Routers 4.6 Debug your AI agents 808★4/90d3 devs/90d -
Traceloop Hub Gateways & Routers 4.5 High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included 217★10/90d5 devs/90d -
LLMRouter Gateways & Routers 4.4 LLMRouter: An Open-Source Library for LLM Routing 2.1k★1/90d1 devs/90d -
RouteLLM Gateways & Routers 3.8 A framework for serving and evaluating LLM routers - save LLM costs without compromising quality 5.1k★0/90d0 devs/90d -
BricksLLM Gateways & Routers 3.3 🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs. 1.2k★0/90d0 devs/90d -
Nexus Gateways & Routers 3.3 Govern & Secure your AI 434★0/90d0 devs/90d -
Lasso MCP Gateway Gateways & Routers 3.3 A plugin-based gateway that orchestrates other MCPs and allows developers to build upon it enterprise-grade agents. 377★0/90d0 devs/90d -
Helicone AI Gateway Gateways & Routers 3.2 The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced. 607★0/90d0 devs/90d -
GPTRouter Gateways & Routers 2.9 Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability. 454★0/90d0 devs/90d -
Not Diamond Gateways & Routers 2.6 Not Diamond Python SDK 92★0/90d0 devs/90d -
Vercel AI Gateway Provider Gateways & Routers 2.2 AI Gateway Provider for Vercel AI SDK 34★0/90d0 devs/90d