B2B Review LabSoftware and business finance research

Home

Best AI Gateway Software 2026

LiteLLM is the best overall AI gateway for teams that want an open-source gateway they can self-host, with one API across 140+ providers and 1,800+ models.

Updated

Top products

  1. Top pick
    1

    LiteLLM

    For teams that want an open-source gateway they can self-host across a broad provider mix.

  2. 2

    Portkey

    For teams that want one API across 250+ LLMs and published hosted plans.

  3. 3

    Cloudflare AI Gateway

    For teams using Cloudflare that want free analytics, caching and rate limits for AI requests.

  4. 4

    Kong AI Gateway

    For teams extending Kong API management to LLM, MCP and A2A traffic.

  5. 5

    OpenRouter

    For teams that want one API across 600+ models and 80+ providers on Standard.

  6. 6

    TrueFoundry

    For teams that need one gateway across models with VPC, on-prem or air-gapped deployment.

  7. 7

    Vercel AI Gateway

    For teams building on Vercel that want one API across 400+ models and automatic fallbacks.

  8. 8

    Helicone

    For teams that lead with LLM request observability and need gateway caching, rate limits and fallbacks.

See the full comparison

Use the situation pages to compare self-hosted and open-source gateways, LLM cost control and budgets, LLM request logging and observability, enterprise SSO and guardrails, a single API across many models, or API management with AI gateway features.

General application performance monitoring and distributed tracing belong in the separate observability category; this category compares LLM gateway request paths and controls.

Get listed in AI Gateway software comparisons

A vendor profile listing costs $9.90 via Stripe and goes live within 24 hours of payment. A place in our AI Gateway comparison lists costs a fee, and links are dofollow. Factual corrections are free. Suggest your product with a short justification.

Submit your software for this category · Review sites and directories for vendors

Frequently asked questions

What is an AI gateway and what do teams use for routing requests across model providers?

An AI gateway is a proxy between your applications and model providers that exposes one OpenAI-compatible API, routes and falls back between providers, and records usage. LiteLLM, Portkey, Cloudflare AI Gateway, Kong AI Gateway and OpenRouter each route requests across providers.

Which LLM gateway can I self-host so prompts stay in my VPC?

LiteLLM is open source with an MIT-licensed core outside its enterprise directory, and Portkey's open-source gateway can be hosted yourself. TrueFoundry lists VPC, on-prem and air-gapped deployment.

How much does an AI gateway cost?

Portkey's Production plan is $49 a month, Helicone's Pro plan is $79 a month, TrueFoundry's Pro plan is $25 per user a month, and Kong's AI Management Plus plan starts at $25 a month plus usage. Cloudflare AI Gateway's core features are free, and OpenRouter charges a 5.5% fee on Standard credits.

Can a gateway fail over when OpenAI or Anthropic is down?

Yes. LiteLLM routing includes cooldowns and fallbacks, Cloudflare AI Gateway lists model fallback, and Vercel AI Gateway applies automatic fallbacks during provider outages.

Is an LLM proxy the same as an AI gateway?

The terms are used for the same layer: an LLM proxy or LLM gateway is a gateway that fronts model providers. LiteLLM titles its own page "Open-Source AI Gateway & LLM Proxy".