Jina Embeddings v4: Self-Hosting & Deployment Guide
Embed text at scale with Jina Embeddings v4 on LLM.API—ideal for search, RAG, and clustering via the OpenAI-compatible embeddings API.
What is Jina Embeddings v4?
Choose Jina Embeddings v4 when your pipeline needs dense representations instead of generated prose. Jina's universal multilingual embedding model. 2048 default dimensions (truncatable to 128); 32K context. Used in dense single-vector mode. LLM.API exposes it with OpenAI-compatible embedding calls.
How to run Jina Embeddings v4 yourself
Open weights, 3.8B parameters. Below: how much memory the weights need at each quantization, which hardware fits them, and the commands to serve it.
Jina Embeddings v4 VRAM requirements
| Precision / quantization | Weights | Figure | Source |
|---|---|---|---|
| BF16 (full precision) | 7.5 GB | Estimate | 3.8B params × 2 bytes |
| GGUF Q8_0 | 3.3 GB | File size | jinaai/jina-embeddings-v4-text-retrieval-GGUF |
| GGUF Q4_K_M | 1.9 GB | File size | jinaai/jina-embeddings-v4-text-retrieval-GGUF |
| GGUF Q2_K | 1.3 GB | File size | jinaai/jina-embeddings-v4-text-retrieval-GGUF |
File size = actual download size on Hugging Face. Estimate = parameter count × bytes per weight. Weights only — the KV cache for long contexts needs extra memory; the fit tables below add 15% headroom as a rule of thumb.
GPU requirements: deploy Jina Embeddings v4 on your hardware
| Hardware | BF16 (full precision) | GGUF Q8_0 | GGUF Q4_K_M | GGUF Q2_K |
|---|---|---|---|---|
| NVIDIA H200141 GB | 1× | 1× | 1× | 1× |
| NVIDIA H10080 GB | 1× | 1× | 1× | 1× |
| NVIDIA A100 80GB80 GB | 1× | 1× | 1× | 1× |
| NVIDIA L40S48 GB | 1× | 1× | 1× | 1× |
GPUs needed per variant.
| Hardware | GGUF Q8_0 | GGUF Q4_K_M | GGUF Q2_K |
|---|---|---|---|
| RTX 509032 GB | 1× | 1× | 1× |
| RTX 409024 GB | 1× | 1× | 1× |
| RTX 309024 GB | 1× | 1× | 1× |
GGUF via llama.cpp; more cards or CPU offload for larger files.
| Hardware | GGUF Q8_0 | GGUF Q4_K_M | GGUF Q2_K |
|---|---|---|---|
| Mac, 512 GBM3 Ultra | Fits | Fits | Fits |
| Mac, 192 GBM2 Ultra | Fits | Fits | Fits |
| Mac, 128 GBM4 Max / M3 Max | Fits | Fits | Fits |
| Mac, 64 GBM4 Pro / Max | Fits | Fits | Fits |
Assumes ~75% of unified memory is usable by the GPU.
| Hardware | BF16 (full precision) | GGUF Q8_0 | GGUF Q4_K_M | GGUF Q2_K |
|---|---|---|---|---|
| AWS p5.48xlarge8× H100 · 640 GB | Fits | Fits | Fits | Fits |
| AWS p4de.24xlarge8× A100 80GB · 640 GB | Fits | Fits | Fits | Fits |
| AWS g6e.12xlarge4× L40S · 192 GB | Fits | Fits | Fits | Fits |
| Google Cloud a3-highgpu-8g8× H100 · 640 GB | Fits | Fits | Fits | Fits |
| Azure ND H100 v58× H100 · 640 GB | Fits | Fits | Fits | Fits |
Whole-instance GPU memory; public instance specs.
Skip the deploy — use LLM.API as your endpoint
No GPUs, no quantization trade-offs. Same model, OpenAI-compatible, up to 30% below list price.
Providers
LLM.API routes Jina Embeddings v4 to the providers below, with discounted effective rates versus list price.
List price by provider
InputOutputProvider list prices; the LLM.API discount applies on top.
| Provider | Pricing | Context | Capabilities |
|---|---|---|---|
| jina | in $0.02; out $0 per 1M tokens | 33K tokens | — |
Prices and availability from the LLMAPI catalogue, updated nightly. Last updated 8 Oct 2026.
Try this model
Test Jina Embeddings v4 right here — free to start.
Suggestions for your first prompt
Code snippet
Call Jina Embeddings v4 through the OpenAI-compatible API — POST /v1/embeddings.
Switching from OpenAI? Change 2 lines.
- base_url="https://api.openai.com/v1"
- api_key="YOUR_OPENAI_KEY"
+ base_url="https://api.llmapi.ai/v1"
+ api_key="YOUR_LLMAPI_KEY"Everything else stays the same — SDK, message format, tools, streaming. Set model to jina-embeddings-v4 and the call runs unchanged.
curl https://api.llmapi.ai/v1/chat/completions \
-H "Authorization: Bearer $LLMAPI_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "jina-embeddings-v4",
"messages": [
{"role": "user", "content": "Give me three crisp launch checklist items."}
]
}'from openai import OpenAI
client = OpenAI(
api_key="YOUR_LLMAPI_KEY",
base_url="https://api.llmapi.ai/v1",
)
resp = client.chat.completions.create(
model="jina-embeddings-v4",
messages=[
{"role": "system", "content": "You are a precise product assistant."},
{"role": "user", "content": "Give me three crisp launch checklist items."},
],
)
print(resp.choices[0].message.content)import OpenAI from "openai";
const client = new OpenAI({
apiKey: process.env.LLMAPI_KEY,
baseURL: "https://api.llmapi.ai/v1",
});
const resp = await client.chat.completions.create({
model: "jina-embeddings-v4",
messages: [
{ role: "user", content: "Give me three crisp launch checklist items." },
],
});
console.log(resp.choices[0].message.content);stream = client.chat.completions.create(
model="jina-embeddings-v4",
messages=[{"role": "user", "content": "Write a haiku about latency."}],
stream=True,
)
for chunk in stream:
delta = chunk.choices[0].delta.content
if delta:
print(delta, end="", flush=True){
"model": "jina-embeddings-v4",
"messages": [
{"role": "system", "content": "You are a precise product assistant."},
{"role": "user", "content": "Give me three crisp launch checklist items."}
]
}ENDPOINTS
Supported endpoints & features
Base URL https://api.llmapi.ai/v1 · model ID jina-embeddings-v4 · OpenAI-compatible.
POST /v1/chat/completionsChat Completions — supported
| Feature | Status | How to set it |
|---|---|---|
| Function calling (tools) | Not supported | tools, tool_choice |
| Parallel tool calls | Not supported | parallel_tool_calls |
| JSON mode | Not supported | response_format: {"type": "json_object"} |
| Structured outputs | Not supported | response_format: {"type": "json_schema", …} |
| Streaming | Not supported | stream: true |
| Vision (image input) | Not supported | image_url content parts |
| Web search | Not supported | web_search |
ERRORS
Errors & fallback routing
| Code | What it means | What to do |
|---|---|---|
401 | Missing or invalid API key. | Send Authorization: Bearer YOUR_LLMAPI_KEY and check the key is active. |
429 | Rate limited, or the upstream provider is throttling the request. | Back off and retry with jitter; the gateway also retries the request on another provider where one is available. |
5xx | Upstream provider error or timeout. | Retry; fallback routing sends the retry to the next healthy provider for this model. |
When a provider fails or throttles, the request is routed to the next provider serving this model — the ones listed in the providers table above.
Jina Embeddings v4 in production
What the model is good at.
Batch throughput
Designed for embedding large corpora via the OpenAI-compatible API.
Low-latency lookups
Suitable for online retrieval when paired with a vector store. Tuned to how teams typically call Jina Embeddings v4.
Corpus analytics
Enables semantic exploration of knowledge bases and tickets. Tuned to how teams typically call Jina Embeddings v4.
Cross-document matching
Supports near-duplicate detection and topical grouping. Reflects Jina positioning for this endpoint.
Retrieval readiness
Fits RAG pipelines that need stable document and query embeddings. Reflects Jina positioning for this endpoint.
What you get when you call Jina Embeddings v4 through LLM.API.
Unified AI Routing
Reach Jina Embeddings v4 and sibling models through one OpenAI-compatible endpoint.
One endpoint, every model.Cost Control
Compare provider price points and keep spend visible as you scale Jina Embeddings v4.
More performance, less spend.Reliability Layer
Retry and route across configured providers when a single upstream blips.
Never go dark on users.Observability
Practical: Trace prompts, tokens, and errors for Jina Embeddings v4 alongside the rest of your stack.
See every token, everywhere.Drop-in SDKs
Production: Keep using familiar OpenAI client patterns with base URL https://api.llmapi.ai/v1.
Think tasks, not models.Model Breadth
Practical: Swap Jina Embeddings v4 for chat, media, or embedding alternatives without rewriting auth.
Scale from 1 to millions.
When to Use — When NOT to Use
Use it if...
- Throughput and cost matter more than generative prose quality (Jina Embeddings v4)
- You are building search, RAG, or clustering on text (Jina Embeddings v4)
- You need consistent vectors from an OpenAI-compatible embeddings API (Jina Embeddings v4)
Avoid if...
- You need generative answers instead of vectors
- You only need OCR or speech features
- You require cross-model vector compatibility without re-indexing
COMMUNITY
What developers say about embedding models
Summarised from publicly published developer and community reviews of this model family. Opinions are the sources’, not LLM.API’s, and may not be specific to Jina Embeddings v4.
- Side-by-side scoring puts OpenAI embeddings slightly ahead of Cohere overall, largely on ecosystem and community support.
- Cost comparisons favour usage-based OpenAI pricing for small and mid-sized workloads.
- Retrieval quality differences are workload-specific; reviewers recommend evaluating on your own corpus before committing.
SOURCES
Frequently Asked Questions
Is Jina Embeddings v4 a chat model?
No—Jina Embeddings v4 is categorized as a embedding model. Use the matching API surface rather than assuming chat completions.
How is Jina Embeddings v4 priced on LLM.API?
Listed pricing metadata shows: In $0.02 / 1M tokens. LLM.API may offer discounted effective rates (illustrative ~30% callout vs list when available).. Confirm live rates in the LLM.API dashboard or docs before production budgeting.
Can Jina Embeddings v4 generate paragraphs of text?
No. Jina Embeddings v4 returns embeddings (vectors). Pair it with a chat model if you need generated language.
Can I use tools or structured outputs with Jina Embeddings v4?
Tooling support varies; for pure embedding models, prefer the modalities listed rather than assuming chat tools.
Which providers serve Jina Embeddings v4?
LLM.API currently lists: jina. Availability can vary by region and account.
What is Jina Embeddings v4?
Jina's universal multilingual embedding model. 2048 default dimensions (truncatable to 128); 32K context. Used in dense single-vector mode. On LLM.API it is addressed as `jina-embeddings-v4`.
How do I call Jina Embeddings v4 via API?
Send OpenAI-compatible requests to https://api.llmapi.ai/v1 with model "jina-embeddings-v4" and your LLM.API key. See the code snippet on this page.
What are limitations of Jina Embeddings v4?
Like other API models, Jina Embeddings v4 can be wrong, incomplete, or uneven on edge cases. Validate outputs for high-stakes use. Media/OCR/STT models additionally depend on input quality.
What is the context length for Jina Embeddings v4?
Reported context for Jina Embeddings v4 is 33K tokens. Always verify the active provider row if multiple providers are listed.
When should I choose Jina Embeddings v4?
Throughput and cost matter more than generative prose quality — especially when you specifically need Jina Embeddings v4.
Get one key to every model
Swap your API key. Keep your code.