Link-Checked Directory · 2026

10 Leading AI Gateway Platforms

A curated tour of the middleware layer that unifies LLM provider access — routing, governing, and monitoring traffic across models. From enterprise governance stacks to open-source self-hosted gateways and edge-native model routers. Every listing has been checked for a live, working destination.

9Gateways Listed
3Platform Categories
100%Links Verified

Enterprise & Governance-First AI Gateways

3 Platforms
  1. TrueFoundry AI Gateway

    Enterprise-grade gateway managing 1,600+ models with unified governance, real-time observability, guardrails, MCP integration, and routing/fallback across 250+ LLM providers.

    Visit →
  2. SS&C AI Gateway

    Vertically integrated, governance-first platform for regulated industries like financial services, offering secure LLM chat, pre-built agents, and a developer toolkit with built-in guardrails.

    Visit →
  3. Kong AI Gateway

    Enterprise AI connectivity platform governing LLM, MCP, and agent-to-agent traffic with centralized security, semantic caching, quota management, and multi-LLM routing in one gateway.

    Visit →

Open-Source & Self-Hosted LLM Gateways

3 Platforms
  1. LLM Gateway

    Open-source (AGPLv3), self-hostable unified API for 40+ LLM providers with real-time cost analytics, automatic failover, and drop-in OpenAI SDK compatibility; bring-your-own-keys tier is free.

    Visit →
  2. LiteLLM

    Open-source AI gateway and LLM proxy putting 140+ providers and 1,800+ models behind one OpenAI-compatible key, with spend tracking, smart routing, and self-hosting anywhere, even air-gapped.

    Visit →
  3. MLflow AI Gateway

    Gateway built into the open-source MLflow AI platform, exposing an OpenAI-compatible endpoint for any LLM provider with native tracing, evaluation, and MCP server access management, licensed Apache 2.0.

    Visit →
  4. Bifrost

    The Fastest Enterprise AI Gateway - Built for enterprise-grade reliability, governance, and scale.

    Visit →

Edge & Model-Routing Platforms

3 Platforms
  1. OpenRouter

    Unified interface for 400+ models across 70+ providers, letting developers find the best model and price for any prompt with automatic fallback and edge-optimized routing.

    Visit →
  2. Cloudflare AI Gateway

    Intelligent control plane for AI applications offering dynamic model routing, response caching, usage analytics, and unified billing across providers, built on Cloudflare's global network.

    Visit →
  3. KrakenD

    Stateless, high-performance open-source API gateway extended with AI capabilities — unified LLM interfaces, prompt guardrails, token/cost control, and a built-in MCP server, handling 80K+ requests/second.

    Visit →