StatusOperational Live status
LLMAPI discountUp to −25%
Models on LLMAPI8
From$0.3 / 1M blended
RegionsUS
Best uptime (24h)100.00%
Verdict
Baseten provides fast, scalable inference infrastructure for open-source models with dedicated deployments and autoscaling. Through LLMAPI you reach 8 Baseten models on the same OpenAI-compatible endpoint as every other provider, so switching between them is a one-string change.
Good fit for
- Text Generation
- Speech-to-Text
- Best for High Volume Production
- Open-Weight Models
- Best for Local Deployment
- Self-Hosted / On-Premise
Consider another provider for
- No code generation models in this catalog
- No image generation models in this catalog
- No vision models in this catalog
- No video generation models in this catalog
Key facts
Where a provider does not document something we say so rather than guess. Everything LLMAPI records about Baseten, in one table.
Overview | |
| Provider | Baseten |
| Website | baseten.co |
| Best for | Production inference for open models with autoscaling |
| Models on LLMAPI | 8 |
| Popular models | DeepSeek V3.2, DeepSeek R1, Llama 4 Maverick, Qwen3-235B, Kimi K2, GLM-4.5 |
Access & routing | |
| API compatibility | OpenAI-compatible — /v1/chat/completions |
| Model ID prefix | baseten/<model> |
| Regions | US |
| Fallback | Configurable — on 429 or 5xx the router switches to any other model or provider on your list |
| Billing | One invoice across every provider, with per-key spend limits |
| Volume discount | Eligible |
Performance (median across listed models) | |
| Blended price / 1M | $1 |
| Uptime (24h) | 99.95% (median across listed models) |
Modality | |
| Tags | |
Price & performance | |
| Tags | |
Deployment | |
| Tags | |
Trust & safety | |
| Tags | |
Privacy & data | |
| Inference location | US |
| Data residency | Not documented by the provider |
| Default retention | Not documented by the provider |
| Zero-data retention | Not documented by the provider |
| Training on API data | Not documented by the provider |
| Human review | Not documented by the provider |
Compliance & lifecycle | |
| Certifications | SOC 2 · ISO 27001 · HIPAA · GDPR |
| Deprecation notice | Not documented by the provider |
| Operational status | Operational Live status |
Prices and context from the OpenRouter public catalogue; uptime and output speed from OpenRouter provider endpoints; quality scores from LiveBench. Refreshed nightly — last updated 2026-09-29. — means no figure is published for that model.
Best Baseten models
A quick view of how Baseten 's 8 models compare on intelligence, output speed and price — so you can pick the right one for your use case.
Most intelligent
#1GLM-4.544
#2Kimi K241
#3DeepSeek V3.238
#4Llama 4 Maverick37
Intelligence index · 8 models
Fastest
#1Qwen3-235B1,017 t/s
#2GLM-4.5882 t/s
#3Custom deployments719 t/s
#4Kimi K2691 t/s
Output tokens / second · 8 models
Lowest price
#1DeepSeek R1$1.03
#2Kimi K2$1.76
#3Whisper Large v3$4.78
#4Qwen3-235B$4.86
Blended price per 1M tokens · 8 models
Compared with other hosts
How Baseten sits against the rest of the catalog, using the same measurements shown on every provider page.
- Price. Median blended price of $5.75 per 1M tokens — 6% below the $6.13 median across all 50 providers in the catalog.
- Throughput. Median output speed of 556 tokens/s, 60% faster than the 348 tok/s catalog median.
- Catalog depth. 8 models listed, against a catalog average of 5 per provider.
- Integration. Identical to every other provider here — same endpoint, same SDK, same keys, so a switch costs one string change.
Median blended price per 1M tokens
lower is better| Baseten | $5.75 | |
| SiliconFlow | $5.65 | |
| Modal | $5.61 | |
| Cohere | $5.50 | |
| Fireworks | $5.50 | |
| Novita | $5.46 |
Median output speed
higher is better| Baseten | 556 tok/s | |
| SiliconFlow | 758 tok/s | |
| Modal | 501 tok/s | |
| Cohere | 310 tok/s | |
| Fireworks | 480 tok/s | |
| Novita | 312 tok/s |
Figures are medians across the models listed on each provider page and are refreshed with the catalog.
Models & pricing
Every Baseten model reachable with your LLMAPI key. Click a column heading to sort.
| Model | API model name | Uptime 24h | Price / 1M | Context |
|---|---|---|---|---|
| DeepSeek V3.2 | baseten/deepseek-v3-2 | 99.91% | $ 0.32 | 164 k |
| DeepSeek R1 | baseten/deepseek-r1 | 99.95% | $ 1.15 | 64 k |
| Llama 4 Maverick | baseten/llama-4-maverick | 99.95% | $ 0.3 | 1049 k |
| Qwen3-235B | baseten/qwen3-235b | — | — | — |
| Kimi K2 | baseten/kimi-k2 | 100.00% | $ 1 | 131 k |
| GLM-4.5 | baseten/glm-4-5 | 99.97% | $ 1 | 131 k |
| Whisper Large v3 | baseten/whisper-large-v3 | — | — | — |
| Custom deployments | baseten/custom-deployments | — | — | — |
Price is a blended per-1M-token figure; latency is time to first token and throughput is output tokens per second, measured on the LLMAPI edge.
Cost calculator
Pick a model, enter your traffic, and see the monthly bill at LLMAPI rates.
Estimates use the blended per-1M-token price shown in the table above. Word counts differ by language — Cyrillic and CJK text uses 2–3× more tokens per word.
Baseten via LLMAPI
Same models, same features, one key. Prefix the model ID with baseten/ and point your OpenAI client at our base URL.
# Python · OpenAI SDK from openai import OpenAI client = OpenAI( base_url="https://api.llmapi.ai/v1", api_key="LLMAPI_KEY", ) r = client.chat.completions.create( model="baseten/deepseek-v3-2", messages=[{"role": "user", "content": "Hello"}], )
| Pricing | Eligible for LLMAPI volume discounts; billed on one invoice with every other provider. |
| Features | Full pass-through — tool calling, JSON schema, streaming, vision and reasoning behave exactly as on Baseten’s own API. |
| Fallback | Configurable. On 429 or 5xx the router switches to any model or provider on your fallback list. |
| Regions | US |
| Your data | LLMAPI stores request metadata only — model, token counts, latency and status. No prompt or completion content. |
Capabilities & use cases
Each tag below is its own catalog page listing every provider that shares it.
Developer resources
Where to go next.
Join thousands of developers building on one API key
Every provider in the catalog, one key, one invoice.
Questions
How do I call Baseten models through LLMAPI?
Point any OpenAI-compatible client at https://api.llmapi.ai/v1 and use the model ID baseten/deepseek-v3-2. No other change is needed.
Does Baseten cost more through LLMAPI?
No. This provider is eligible for LLMAPI volume discounts, so heavy usage lands below list price.
Which regions are used?
US
What happens if the provider returns an error?
On 429 or 5xx responses the router falls back to any other model or provider on your configured list, so requests keep succeeding.
How many Baseten models are available?
8 at the moment, all listed in the models table above and updated as the provider ships new ones.
Related providers
Providers covering similar use cases.