LLM API
Published Updated

OpenRouter alternatives: where to route next

We compared 20 OpenRouter alternatives, from routers and gateways to inference clouds, on cost, control, latency and compliance. LiteLLM is the pick for self-hosting, Requesty for a drop-in swap, Groq for latency, DeepInfra for cheap open models, AWS Bedrock for enterprise and LLM API for mixed modalities.

OpenRouter got you started; these OpenRouter alternatives are where to route next. We compared 20 routers, gateways and inference clouds on cost, control, latency and compliance, with the same ten criteria for every entry and no paid placements. Answer ten questions in the route planner and get a shortlist built for your stack, not a generic top ten.

Why teams look elsewhere

Four reasons people outgrow a single router, and they are rarely about the model list.

  • A fee on every token

    A platform margin of about 5% on top of provider prices is invisible at prototype volume and a real line item at production volume. Routers that bill provider rates, or let you bring your own keys, close that gap.

  • Prompts that cannot travel

    Once legal reviews the data path, a US-only proxy in front of your prompts stops being acceptable. Regional hosting, self-hosted gateways and cloud platforms keep traffic inside a perimeter you can name.

  • Latency budgets

    Voice agents and live UX spend their whole budget in the first second. A direct inference provider with no extra hop usually beats any router on speed, whatever the catalogue says.

  • Control and visibility

    Per-team budgets, spend caps, traces, caching and one invoice stop being nice-to-have the moment a second team starts calling models on the company card.

When to stay on OpenRouter: you are prototyping, you want one bill across hundreds of models, and a small fee is cheaper than running infrastructure. The planner says so too when that is the honest answer.

What the gateway itself costs you

Token prices are roughly the same wherever you route; the difference is the fee sitting on top. Drag the slider to your monthly spend.

$1,000 a month$12,000 a year in tokens

Yearly gateway fee at$1,000a month of token spend, cheapest first
GatewayFee shapeFee a year
LiteLLM (self-hosted)no fee — you run the serversNo fee
Portkey$49 / month flat$588
Cloudflare AI Gateway5% on billed usage$600
Requesty5% of spend$600
OpenRouter5.5% on credit top-ups$660

Gateway fee only: the tokens are billed on top and cost about the same everywhere. Percentage fees scale with you; a flat fee stops growing. Self-hosting costs nothing in fees, but you pay for servers and the engineer who keeps them up. Fee shapes are taken from each vendor's own pricing page, checked 21 September 2026; the full working is in how we compared 20 OpenRouter alternatives.

Route planner

Ten questions to your shortlist

The live board re-ranks every alternative as you answer. No email, no gate, and you can share the result with the link in your address bar.

What are you building?

This sets how much operational weight you can reasonably carry.

What are you routing?

Most routers are strong on text and thin everywhere else.

Which models does your stack lean on?

Frontier access and fast open-weight serving rarely come from the same place.

Where does it need to run?

Often decided by legal rather than engineering.

What do the privacy rules demand?

Usually the shortest conversation with legal, and the hardest to work around.

How should keys and billing work?

This is the line that splits aggregators from control planes.

What should the router do in the path?

The more logic you want in the hop, the fewer options you have.

What matters most?

Pick the one you would defend in a review, not all of them.

What is pushing you off OpenRouter?

Each wall points at a different kind of alternative.

How much work can the switch take?

Be honest — this is the answer that changes the shortlist most.

Editor's picks by need

If you already know which wall you hit, start here.

  • Best for mixed modalities: LLM API

    Text, vision, speech, video and OCR behind one OpenAI-compatible key, with uptime monitoring and spend controls. Runner-up: Google Vertex AI.

  • Best self-hosted: LiteLLM

    An open-source proxy for 100+ providers with virtual keys, budgets and fallbacks, the closest thing to OpenRouter you can run inside your own perimeter. Runner-up: Kong AI Gateway.

  • Best drop-in swap: Requesty

    The same one-key, one-bill shape with cost-aware routing and caching on top. Migration is a base URL and a key, nothing else. Runner-up: Unify.

  • Lowest latency: Groq

    Purpose-built inference hardware for open-weight models. The pick when voice agents or real-time UX own the latency budget. Runner-up: Fireworks AI.

  • Cheapest open models: DeepInfra

    Aggressive per-token pricing on Llama, Qwen, DeepSeek and friends, on an OpenAI-compatible API with no platform fee layered on top. Runner-up: Together AI.

  • Best for enterprise: AWS Bedrock

    Frontier and open models under the AWS contract, IAM boundary and compliance paperwork your procurement team already signed off. Runner-up: Azure AI Foundry.

Every alternative, side by side

OpenRouter and the 19 alternatives on model access, modalities, hosting, routing and pricing shape.

OpenRouter and 19 alternatives by model access, modalities, hosting, routing and pricing shape
AlternativeModel accessModalitiesHostingRouting & failoverPricing shape
OpenRouterbaseline400+ text modelsText, some visionManaged cloudAutomatic provider fallbackProvider price + platform fee, prepaid credits
LLM APIthat's us396 models, 37+ providersText, vision, speech, video, OCRManaged cloud, EU regionFailover + live uptime monitoringPrepaid credits, pay per token, an invoice for every top-up
Together AI200+ open modelsText, image, embeddingsManaged cloudSingle provider, no cross-vendor failoverPer token, plus hourly dedicated GPUs
Fireworks AI100+ open modelsText, vision, audio, imageManaged cloudSingle providerPer token, plus on-demand GPU hours
Groq~20 curated modelsText, speech-to-textManaged cloudSingle providerPer token, free developer tier
DeepInfra100+ open modelsText, image, speech, embeddingsManaged cloudSingle providerPer token, pay as you go
Novita AI200+ hosted modelsText, image, video, speechManaged cloudSingle providerPer token or per generation
ReplicateThousands of community modelsImage, video, audio, textManaged cloudNonePer second of compute
AWS Bedrock~50 models from selected vendorsText, image, embeddingsManaged cloud, many regions incl. EUCross-region inference, no cross-vendor routingPer token, on your AWS bill; provisioned throughput available
Azure AI FoundryOpenAI + 1000s of catalogue modelsText, image, speech, visionManaged cloud, EU data boundaryRegional deployments, no cross-vendor routingPer token or provisioned units, on the Azure bill
Google Vertex AIGemini + model gardenText, image, video, speechManaged cloud, EU regionsRegional endpoints, no cross-vendor routingPer token or per media unit, on the GCP bill
PortkeyBring your own provider keysWhatever your providers supportManaged cloud or self-hostedConditional routing, retries, fallbacksPer request tiers, free developer plan, enterprise self-host
LiteLLM100+ providers via your own keysWhatever your providers supportSelf-hosted (managed tier available)Load balancing, retries, fallbacksFree and open source, paid enterprise tier
Kong AI GatewayBring your own provider keysWhatever your providers supportSelf-hosted or hybridPolicy-based routing and rate limitsOpen source core, enterprise licence
Cloudflare AI GatewayBring your own keys + Workers AIText, image, speech via Workers AIManaged edge, EU optionsFallbacks, caching, rate limitsFree tier, usage-based extras
AnyscaleYour own model deploymentsWhatever you deployYour cloud account / VPCYou build itPlatform fee on top of your own compute
Hugging Face InferenceOpen models via partner providersText, image, audio, embeddingsManaged cloudProvider selection per modelFree credits, then pass-through provider pricing
Requesty150+ hosted modelsText, visionManaged cloudCost-aware routing and fallbacksUsage fee on top of provider prices
Eden AI100+ AI services across vendorsText, OCR, speech, image, translationManaged cloud, EU companyProvider fallback per taskPer call, with a monthly plan
UnifyMajor providers and open modelsTextManaged cloudLive benchmark-based routingProvider price plus routing fee

Facts are checked against each vendor’s own documentation and pricing pages on 21 September 2026. Model counts move weekly, so treat them as orders of magnitude, not guarantees.

Coverage at a glance

Every alternative against twelve capabilities. Yes means the platform covers it as a first-class capability; No means it does not, with no half-credit for “on the roadmap”.

Coverage at a glance, twelve capabilities per alternative
AlternativeTextVisionSpeechVideoManaged cloudEU hostingSelf-hostFailoverUnified billingWhite labelEnterpriseDrop-in swap
LLM APIYesYesYesYesYesYesNoYesYesYesYesYes
OpenRouterYesYesNoNoYesNoNoNoNoNoNoYes
AnyscaleYesNoNoNoNoYesYesYesNoNoYesNo
AWS BedrockYesYesNoNoYesYesNoYesYesNoYesNo
Azure AI FoundryYesYesYesNoYesYesNoYesYesNoYesNo
Cloudflare AI GatewayYesYesYesNoYesYesNoYesNoNoNoYes
DeepInfraYesYesYesNoYesNoNoNoNoNoNoYes
Eden AIYesYesYesNoYesYesNoNoYesNoNoYes
Fireworks AIYesYesYesNoYesNoNoYesNoNoNoYes
Google Vertex AIYesYesYesYesYesYesNoYesYesNoYesNo
GroqYesNoYesNoYesNoNoNoNoNoNoYes
Hugging Face InferenceYesYesYesNoYesNoNoNoNoNoNoYes
Kong AI GatewayYesNoNoNoNoYesYesYesYesNoYesNo
LiteLLMYesYesYesNoNoYesYesNoYesNoNoNo
Novita AIYesYesYesYesYesNoNoNoNoNoNoYes
PortkeyYesYesYesNoYesYesYesYesYesNoYesYes
ReplicateNoYesYesYesYesNoNoNoNoNoNoNo
RequestyYesYesNoNoYesNoNoNoYesNoNoYes
Together AIYesYesNoNoYesNoNoNoNoNoNoYes
UnifyYesNoNoNoYesNoNoYesNoNoNoYes

The 20 profiles

What each one actually is, who it suits, and the part their marketing page leaves out.

OpenRouter

A marketplace-style router in front of hundreds of hosted models, with a single OpenAI-compatible endpoint, credits-based billing and automatic fallbacks between upstream providers.

  • Best for: trying many models quickly, side projects, teams that want the widest text-model catalogue without contracts.
  • Watch out for: a per-request fee sits on top of provider prices, support is community-first, and speech, video and OCR coverage is thin compared with the text catalogue.
  • Pricing shape: provider price + platform fee, prepaid credits.
  • Site: openrouter.ai

LLM API

A managed router covering 396 models from 37+ providers behind one key, with per-model uptime monitoring, spend controls, and a white-label router other companies resell under their own brand.

  • Best for: teams running mixed modalities in production, agencies and platforms that need one bill, and companies reselling AI access.
  • Watch out for: no self-hosted edition; the gateway runs as a managed service.
  • Pricing shape: Prepaid credits, pay per token, an invoice for every top-up.
  • Site: the model catalogue

Together AI

An inference cloud running open-weight models on its own GPU fleet, plus fine-tuning and dedicated capacity for steady workloads.

  • Best for: open-model workloads at volume where per-token price and throughput matter more than closed-model access.
  • Watch out for: no access to closed frontier models from OpenAI or Anthropic through the same endpoint.
  • Pricing shape: per token, plus hourly dedicated GPUs.
  • Site: together.ai

Fireworks AI

A performance-focused inference platform for open-weight models, with speculative decoding, LoRA tuning and on-demand deployments.

  • Best for: latency-sensitive production apps built on open models.
  • Watch out for: the catalogue is narrower than a marketplace router and closed frontier models are not included.
  • Pricing shape: per token, plus on-demand GPU hours.
  • Site: fireworks.ai

Groq

Custom LPU hardware serving a curated set of open models at very high throughput through an OpenAI-compatible API.

  • Best for: voice agents, streaming chat and anything where response speed is the product.
  • Watch out for: a small catalogue, capacity limits at peak, and no cross-provider routing.
  • Pricing shape: per token, free developer tier.
  • Site: groq.com

DeepInfra

A low-cost inference provider with an OpenAI-compatible endpoint across open text, embedding, image and speech models.

  • Best for: cost-sensitive batch and background workloads.
  • Watch out for: fewer enterprise controls, lighter SLAs, no closed frontier models.
  • Pricing shape: per token, pay as you go.
  • Site: deepinfra.com

Novita AI

An inference cloud spanning open LLMs plus image, video and speech generation, also available as GPU instances.

  • Best for: media-heavy products that also need text models at low cost.
  • Watch out for: quality of service varies by model; enterprise paperwork is lighter than a hyperscaler’s.
  • Pricing shape: per token or per generation.
  • Site: novita.ai

Replicate

A hosting layer for thousands of community-published models, including image, video and audio pipelines, with custom model deployment.

  • Best for: generative media, experimentation and running your own containerised model.
  • Watch out for: cold starts, per-second billing that is hard to forecast, and inconsistent model maintenance.
  • Pricing shape: per second of compute.
  • Site: replicate.com

AWS Bedrock

Amazon’s managed model service with Anthropic, Meta, Mistral, Amazon and other families, IAM controls, VPC access and regional isolation.

  • Best for: enterprises already on AWS that need procurement, data residency and compliance more than catalogue breadth.
  • Watch out for: model availability differs by region, quotas need raising, and the developer experience is heavier than a router.
  • Pricing shape: per token, on your AWS bill; provisioned throughput available.
  • Site: aws.amazon.com/bedrock

Azure AI Foundry

Microsoft’s AI platform hosting OpenAI models alongside open and partner models, with private networking, content filters and EU data boundary options.

  • Best for: Microsoft-committed enterprises needing OpenAI models with corporate compliance.
  • Watch out for: deployment quotas per region, and the catalogue outside OpenAI is uneven.
  • Pricing shape: per token or provisioned units, on the Azure bill.
  • Site: azure.microsoft.com

Google Vertex AI

Google’s managed platform for Gemini plus a model garden of partner and open models, with grounding, tuning and regional endpoints.

  • Best for: teams standardising on Gemini, or needing long-context and multimodal models under GCP contracts.
  • Watch out for: authentication and project setup are heavier than an API key; pricing differs per modality.
  • Pricing shape: per token or per media unit, on the GCP bill.
  • Site: cloud.google.com/vertex-ai

Portkey

A gateway that sits between your app and any provider key you bring, adding routing rules, caching, retries, budgets, logs and guardrails. Available managed or self-hosted.

  • Best for: platform teams that already hold provider contracts and need control, tracing and spend limits.
  • Watch out for: you still buy the models elsewhere; it is a control plane, not a catalogue.
  • Pricing shape: per request tiers, free developer plan, enterprise self-host.
  • Site: portkey.ai

LiteLLM

An MIT-licensed Python SDK and proxy that normalises 100+ provider APIs into the OpenAI format, with virtual keys, budgets and logging. Run it in your own cluster.

  • Best for: engineering teams that want full control, no vendor in the data path, and provider prices with no markup.
  • Watch out for: you own uptime, upgrades and scaling; the enterprise features sit behind a paid tier.
  • Pricing shape: free and open source, paid enterprise tier.
  • Site: litellm.ai

Kong AI Gateway

Kong’s gateway extended with AI plugins for multi-provider routing, prompt guards, token rate limiting and semantic caching, deployable on-prem.

  • Best for: enterprises that already standardise API traffic on Kong and want AI under the same policy layer.
  • Watch out for: infrastructure-team territory, with no model catalogue and no consumer-grade onboarding.
  • Pricing shape: open source core, enterprise licence.
  • Site: konghq.com

Cloudflare AI Gateway

A thin edge layer that proxies calls to providers, adding analytics, caching, retries and rate limits, with Workers AI for models hosted by Cloudflare.

  • Best for: teams on Cloudflare who want cheap observability and caching without changing providers.
  • Watch out for: not a catalogue or a billing layer; governance features are lighter than dedicated gateways.
  • Pricing shape: free tier, usage-based extras.
  • Site: developers.cloudflare.com/ai-gateway

Anyscale

A managed Ray platform for serving and fine-tuning models on your own infrastructure, including deployment into your VPC.

  • Best for: ML teams with custom models and existing cloud commitments.
  • Watch out for: the heaviest setup on this list, with no ready-made catalogue or router.
  • Pricing shape: platform fee on top of your own compute.
  • Site: anyscale.com

Hugging Face Inference

Inference providers on the Hub route calls to partners such as Together, Fireworks and Novita behind one token, alongside dedicated endpoints.

  • Best for: open-model research, prototypes and anything already anchored on the Hub.
  • Watch out for: no closed frontier models, and production guarantees depend on the upstream partner.
  • Pricing shape: free credits, then pass-through provider pricing.
  • Site: huggingface.co

Requesty

A multi-provider routing layer with caching, fallbacks, per-user budgets and analytics aimed at cutting model spend.

  • Best for: teams whose main pain is an unpredictable model bill.
  • Watch out for: a younger platform with a smaller catalogue and shorter operating history.
  • Pricing shape: usage fee on top of provider prices.
  • Site: requesty.ai

Eden AI

An aggregator covering OCR, translation, speech, moderation and generative models from many vendors under a single key and invoice, with an EU base.

  • Best for: products that need document, speech and translation AI alongside LLMs.
  • Watch out for: task-oriented rather than model-oriented; per-call pricing can exceed direct provider rates.
  • Pricing shape: per call, with a monthly plan.
  • Site: edenai.co

Unify

A router that scores providers on live latency, throughput and cost, then sends each request to the endpoint that best matches your constraints.

  • Best for: engineers who want routing decisions made on measurements rather than a fixed preference list.
  • Watch out for: a smaller catalogue and community; best suited to text workloads.
  • Pricing shape: provider price plus routing fee.
  • Site: unify.ai

Short version, by situation

You are prototyping and want maximum choice. Stay on OpenRouter, or use Hugging Face Inference. The per-request fee is irrelevant at small volume and the catalogue is the widest there is.

You are in production across text, voice and video. LLM API covers all four modalities behind one key with uptime monitoring and one bill. Novita AI is the budget alternative if you can accept lighter guarantees.

Your security team wants nothing in the data path. LiteLLM self-hosted, or Kong AI Gateway if you already run Kong. You keep provider prices with no markup and own the uptime.

Procurement has to sign off. AWS Bedrock, Azure AI Foundry or Google Vertex AI: the model spend lands on a cloud contract you already have, with residency and compliance attached.

Switching from OpenRouter to LLM API

LLM API is OpenAI-compatible, so migration is a base URL and a key.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.llmapi.ai/v1",
    api_key="LLMAPI_KEY",
)

How we compared them

Ten criteria, applied the same way to every entry, from public documentation and hands-on use:

  1. Model breadth and how fast new releases land
  2. Modality coverage: text, vision, speech, video, OCR
  3. Routing, retries and failover behaviour
  4. Pricing shape: markup, credits, invoices, commitments
  5. Spend controls, budgets and per-team reporting
  6. Data residency and regional hosting
  7. Self-hosting and the licence that comes with it
  8. White-label and reseller support
  9. Enterprise readiness: SLAs, SOC 2, procurement
  10. Migration effort from an OpenAI-compatible endpoint

What we could not measure. Latency and uptime vary by region, model and hour, so we did not publish a single speed ranking: any number we quoted would be stale by the time you read it. Support quality is reported, not tested. Where a vendor does not publish a fact, the table says so instead of guessing.

Read the full methodology in how we compared 20 OpenRouter alternatives.

Frequently asked questions

What is the best free OpenRouter alternative?

For self-hosting, LiteLLM is open source and free to run: you pay only your upstream providers. For hosted, Cloudflare AI Gateway's core features are free and sit in front of your own provider keys.

Can I switch from OpenRouter without rewriting code?

Usually yes. Most alternatives on this page expose an OpenAI-compatible endpoint, so you change the base URL, the API key and sometimes the model-ID format. The routing and pricing columns of the comparison flag the ones that need more than that.

Gateway or inference provider: what is the difference?

A gateway routes your requests to providers you already pay and adds control: budgets, caching, logs, failover. An inference provider runs the models itself. Plenty of teams use both, a gateway in front and two or three providers behind it.

What does BYOK mean?

Bring Your Own Key: you plug in your own OpenAI, Anthropic or Google keys, so those providers bill you directly and the router charges only for its own layer, or for nothing at all.

When should I just stay on OpenRouter?

When you are prototyping, want the widest text catalogue with no contract, and the per-request fee is smaller than the cost of running anything yourself.

Is anyone paying to be on this list?

No. LLM API is our own product and is labelled as such wherever it appears. Every other entry is here on merit, scored on the same criteria from public documentation and hands-on use.

You've been invited to LLM API

Top up $50 or more and the friend who invited you gets $20 in credits. We pay the $20; your credits stay yours. Referral terms

Sign up